-- Logs begin at Tue 2022-08-30 23:29:51 UTC, end at Wed 2022-08-31 00:36:45 UTC. -- Aug 31 00:10:29.229810 dv-cinder-852209-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 00:10:29.238261 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:10:29 2022] *** Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: nodename: dv-cinder-852209-8-iscsi Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: machine: x86_64 Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: clock source: unix Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: pcre jit disabled Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: detected number of CPU cores: 4 Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: current working directory: / Aug 31 00:10:29.240226 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:10:29.240912 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: your processes number limit is 47680 Aug 31 00:10:29.240912 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: your memory page size is 4096 bytes Aug 31 00:10:29.240912 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: detected max file descriptor number: 2048 Aug 31 00:10:29.240912 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: lock engine: pthread robust mutexes Aug 31 00:10:29.240912 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: thunder lock: enabled Aug 31 00:10:29.240912 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 00:10:29.240912 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:10:29.279484 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: Python main interpreter initialized at 0x55cc8ee279c0 Aug 31 00:10:29.279484 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: python threads support enabled Aug 31 00:10:29.279484 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: your server socket listen backlog is limited to 100 connections Aug 31 00:10:29.279484 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:10:29.279827 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:10:29.279892 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: *** Operational MODE: preforking *** Aug 31 00:10:29.280139 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:10:29.280139 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: spawned uWSGI master process (pid: 106714) Aug 31 00:10:29.280337 dv-cinder-852209-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 00:10:29.280860 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: spawned uWSGI worker 1 (pid: 106715, cores: 1) Aug 31 00:10:29.283287 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: spawned uWSGI worker 2 (pid: 106716, cores: 1) Aug 31 00:10:29.283287 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:10:29.943747 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:10:29.944830 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:10:31.028638 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:10:31.028638 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: from cryptography.utils import int_from_bytes Aug 31 00:10:31.029299 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:10:31.029299 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: from cryptography.utils import int_from_bytes Aug 31 00:10:31.030697 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:10:31.030697 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: from cryptography.utils import int_from_bytes Aug 31 00:10:31.031133 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:10:31.031133 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: from cryptography.utils import int_from_bytes Aug 31 00:10:33.562996 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:10:33.563613 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:10:33.563774 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:10:33.564157 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:10:33.564414 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:10:33.564807 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.565130 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.565452 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.565774 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.566306 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.566479 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.566770 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.567094 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.567426 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.567680 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.568005 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.568333 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-8-iscsi {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.568656 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.568963 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.569281 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.569601 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.569929 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.570256 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.570556 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.571057 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.571690 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.572049 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.572289 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:10:33.572289 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:10:33.572757 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.572757 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.572915 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:10:33.573002 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.573187 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:10:33.573311 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.573434 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:10:33.573630 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.573966 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.574072 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.574298 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.574535 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.574668 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.574760 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.574923 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.575013 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-8-iscsi {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.575249 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.575398 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.575557 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.575653 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.575877 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.575976 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.576196 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.576358 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.576587 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.576699 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.576788 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.576931 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.577074 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.577255 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.577397 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-8-iscsi {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.577604 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.577740 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.578052 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.578151 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.578356 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.578494 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.578750 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.578944 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.579071 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.579248 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.579370 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.579688 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.579981 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.580093 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.580293 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.580393 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.580615 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.580805 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.580920 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.581119 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.581243 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.581421 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.581527 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.581733 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.581874 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.582090 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.582197 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.582402 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.582499 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.582707 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.582802 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.582966 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.583065 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.583219 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.583325 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.583541 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.583641 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.583866 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.583964 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.584177 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.584295 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-8-iscsi {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.584485 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.584610 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.584792 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.584920 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.585100 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.585230 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.585394 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.585636 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.585725 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.585973 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.586202 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.586312 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.586521 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.586644 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.587375 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.587494 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.587727 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.587947 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.588055 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.588284 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.588389 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.588601 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.588698 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.588931 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.589035 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.589235 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.589327 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.589538 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.589633 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.589861 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.589962 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.590241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.590334 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.590565 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.590675 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.590884 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.590999 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.591206 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.591308 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.591532 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.591635 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.591881 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.591978 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.592219 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.592310 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.592553 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.592651 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.592811 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.592900 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.593071 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.593200 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.593396 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.593492 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.595378 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.595490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.595490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.595637 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.595717 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.595784 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.595848 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.595913 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.595984 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596057 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596137 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596205 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596268 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596343 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596408 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596478 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596555 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596626 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596697 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596770 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596845 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596925 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.596998 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.597199 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.597529 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.597655 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.597775 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.597924 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.598051 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.598222 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.598405 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.598561 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.598653 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.598847 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.598943 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.599170 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.599271 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.599479 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.599658 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.599831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.599977 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.600071 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.600295 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.600389 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.600621 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.600723 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.600932 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.601034 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.601235 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.601351 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.601588 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.601837 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.601971 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.602223 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.602331 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.603093 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.603206 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.603404 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.603526 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.603749 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.604066 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.604183 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.604377 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.604484 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.604701 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.604799 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.605012 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.605102 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.605322 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.605413 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.605632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.605723 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.605958 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.606071 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.606268 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.606438 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.606574 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.606678 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.606883 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.607123 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.607224 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.607434 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.607586 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.607739 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.607900 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.608067 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.608210 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.608329 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.608657 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.608755 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.608987 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.609095 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.609302 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.609400 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.609613 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.609762 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.609986 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.610085 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.610261 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.610363 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.610605 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.610948 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.611086 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.611294 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.611409 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.611622 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.611717 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.611934 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.612026 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.612245 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.612339 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.612576 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.612723 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.612874 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.612974 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.613181 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.613275 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.613503 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.613598 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.613820 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.613969 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.614150 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.614374 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.614461 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.614704 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.614808 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.615030 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.615131 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.615353 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.615461 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.615659 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.615807 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.615956 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.616140 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.616283 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.616383 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.616548 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.616670 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.616848 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.616967 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.617221 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.617418 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.617566 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.617838 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.618180 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.618329 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.618419 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.618565 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.618763 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.618924 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.619093 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.619472 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.619643 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.619932 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.620097 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.620247 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.620386 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.620523 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.620661 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.620819 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:10:33.620972 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.621119 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.621264 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.621264 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.621543 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.621644 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.621727 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.621899 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.622012 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.622228 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.622325 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.622544 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.622648 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.622867 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.622959 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.623185 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.623342 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.623486 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.623625 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.623795 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.623926 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.624115 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.624248 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.624413 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.624551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.624777 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.624915 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.625093 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.625221 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.625414 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.625552 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.625730 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.625959 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.626088 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.626211 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.626381 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.626509 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.626699 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.626919 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.627047 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.627194 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.627344 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.627482 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.627619 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.627765 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.628005 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.628168 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.628385 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.628531 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.628676 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.629017 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.629169 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.629308 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.629456 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.629596 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.629734 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.629734 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.630039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.630191 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.630330 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.630475 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.630772 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.630914 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.631052 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.631200 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.631338 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.631690 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.631849 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.631989 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.632128 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.632296 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.632445 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.632584 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.632732 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.632871 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.633016 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.633173 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.633313 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.633451 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.633588 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.633756 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.633920 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.634076 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.634228 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.634374 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.634521 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.634661 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.634808 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.634954 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.635093 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.635231 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.635371 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.635515 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.635663 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.635804 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.635948 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.636093 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.636229 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.636364 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.636512 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.636647 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.636787 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.636939 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.637071 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.637156 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.637245 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.637386 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.637475 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.637696 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.637811 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.638082 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.638283 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.638550 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.638693 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.639611 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.639747 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.639884 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.639980 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640062 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640151 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640151 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640296 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640384 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640472 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640561 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640641 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640719 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640798 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.640969 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.641078 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.641277 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.641374 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.641583 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.641696 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.641937 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.642033 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.642212 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.642315 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.642538 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.642640 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.642849 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.642940 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.643154 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.643245 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.643457 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.643556 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.643759 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.643849 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.644076 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.644169 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.644379 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.644480 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.644696 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.644788 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.645007 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.645098 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.645319 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.645410 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.645633 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.645797 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.645964 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.646103 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.646276 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.646428 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.646588 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.646732 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.646908 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.647066 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.647214 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.647513 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.647837 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.647997 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.648164 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.648303 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.648448 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.651285 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.651467 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.651618 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.651762 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.651915 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.652056 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.652195 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.652333 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.652470 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.652606 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.652764 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.652902 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.653038 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.653176 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.653312 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.653449 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.653599 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.653744 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.653948 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.654095 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.654235 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.654372 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.654517 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.654666 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.654803 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.654939 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.655083 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.655230 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.655368 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.655504 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.655647 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.656121 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.656269 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.656416 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.656563 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.656700 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.656855 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.657000 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.657156 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.657385 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.657531 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.657669 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.657806 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.657969 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.658117 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.658273 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.658413 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.658562 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.658715 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.658852 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.659003 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.659162 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.659301 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.659445 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.659583 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.659730 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.659876 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.660014 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.660150 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.660286 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.660430 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.660579 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.660725 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.660863 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.661000 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.661148 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.661285 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.661421 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.661569 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.661707 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.661860 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.662005 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.662142 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.662289 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.662445 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.662584 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.662722 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.662865 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.663003 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.663148 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.663286 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.663423 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.663560 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.663705 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.663843 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.663988 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.664126 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.664293 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.664433 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.664576 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.664715 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.664883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.665060 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.665222 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.665359 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.665504 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.665648 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.665799 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.665799 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.666083 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.666240 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.666378 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.666522 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.666659 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.666804 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.666941 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.667077 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.667212 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.667375 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.668072 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.668217 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.668361 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.668508 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.668654 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.668800 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.668939 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.669074 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.669210 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.669347 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.669494 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.669692 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.669832 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.670064 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.670213 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.670360 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.670517 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.670655 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.670791 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.670927 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.671064 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.671199 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.671343 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.671481 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.671616 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.671752 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.671887 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.672024 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.672172 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.672320 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.672457 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.672593 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.672728 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.672864 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.673008 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.673146 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.673282 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.673419 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.673554 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.673704 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.673857 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.674009 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.674156 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.674292 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.674428 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.674575 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.674712 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.674847 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.674989 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.674989 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.675247 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.675392 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.675536 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.675673 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.675818 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.676204 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.676344 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.676488 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.676488 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.676759 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.676904 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.677042 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.677190 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.677340 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.677490 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.677714 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.677927 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.678081 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.678218 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.678354 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.678501 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.678649 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.678787 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.678922 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.679058 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.679202 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.679340 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.679476 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.679612 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.679748 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.679897 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.680046 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.680191 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.680328 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.680495 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.684703 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.684854 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.685007 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.685146 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.685290 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.685290 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.685548 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.685685 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.685856 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.686002 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.686139 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.686275 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.686411 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.686557 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.686697 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.686833 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.686969 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.687114 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.687253 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.687398 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.687545 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.687697 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.687912 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.688062 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.688207 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.688353 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.688491 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.688626 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.688764 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.688900 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.689046 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.689046 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.689320 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.689320 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.689594 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.689731 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.689905 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.690050 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.690187 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.690322 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.690458 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.690593 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.690738 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.690891 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.691035 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.691186 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.691186 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.691478 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.691615 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.691760 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.691898 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.692035 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.692170 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.692306 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.692441 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.692595 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.692741 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.692885 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.693045 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.693183 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.693326 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.693475 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.693613 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.693748 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.693901 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.694046 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.694183 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.694330 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.694474 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.694620 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.694756 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.694902 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.695046 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.695184 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.695326 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.695463 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.695463 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.695727 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.695727 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.696064 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.696064 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.696359 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.696505 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.696643 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.696797 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.696935 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.697071 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.697215 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.697353 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.697489 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.697637 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.697775 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.698034 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.698175 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.698313 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.698465 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.698612 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.698760 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.698904 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.699042 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.699178 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.699323 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.699323 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.699581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.699723 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.699860 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.699997 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.700188 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.700188 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.700481 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.700481 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.700738 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.700887 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.701025 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.701161 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.701297 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.701297 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.701554 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.701699 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.701836 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.701998 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.702135 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.702280 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.702428 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.702583 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.702722 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.702857 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.702993 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.703128 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.703263 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.703407 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.703553 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.703553 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.703809 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.703946 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.704098 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.704251 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.704394 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.704534 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.704669 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.704805 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.704949 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.705087 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.705229 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.705366 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.705501 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.705645 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.705790 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.705965 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.706103 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.706239 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.706384 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.706522 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.706667 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.706805 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.706941 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.707077 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.707220 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.707366 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.707503 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.707647 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.707794 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.707794 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.708135 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.708287 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.708425 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.708561 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.708704 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.708842 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.708978 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.709126 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.709263 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.709409 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.709546 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.709704 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.709870 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.710027 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.710171 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.710316 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.710460 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.710597 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.710733 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.710882 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.711020 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.711156 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.711298 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.711446 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.711596 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.712244 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.712390 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.712527 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.712662 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.712797 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.712946 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.713095 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.713231 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.713374 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.713519 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.713656 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.713809 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.713972 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.714109 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.714245 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.714381 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.714516 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.714663 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.714807 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.714952 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.715090 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.715502 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.715649 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.715795 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.715942 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.716080 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.716216 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.716351 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.716532 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.716675 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.716812 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.716948 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.717085 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.717228 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.717373 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.717518 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.717654 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.717801 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.717970 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.718133 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.718356 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.718499 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.718643 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.718780 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.718917 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.719062 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.719201 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.719345 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.719483 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.719628 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.719765 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.719910 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.720048 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.720190 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.720329 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.720465 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.720601 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.720746 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.720884 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.721020 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.721156 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.721292 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.721437 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.721582 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.721719 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.721916 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.722078 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.722223 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.722375 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.722375 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.722653 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.722798 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.722940 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.723082 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.723302 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.723464 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.723607 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.723999 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.724153 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.724392 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.724548 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.724693 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.724836 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.724985 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.725129 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.725278 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.725431 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.725576 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.725729 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.725901 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.726052 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.726204 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.726348 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.726491 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.726635 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.726778 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.726920 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.727071 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.727223 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.727403 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.727652 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.728375 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.728595 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.728750 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.728897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.729034 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.729170 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.729313 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.729313 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.729583 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.729721 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.729930 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.730084 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.730233 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.730233 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.730233 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.730640 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.730777 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.730913 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.731048 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.731048 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.731318 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.731318 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.731614 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.731614 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.732043 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.732296 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.732523 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.732751 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.732984 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.733216 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.733428 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.733654 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.733795 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.733955 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.733955 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.734227 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.734227 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.734498 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.734498 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.734776 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.734913 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.735050 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.735194 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.735361 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.735580 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.735729 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.735932 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.736073 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.736217 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.736355 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.736516 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.736655 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.736791 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.736927 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.737063 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.737207 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.737353 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.737492 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.737628 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.737764 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.738064 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.738297 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.738551 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.738828 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.738988 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.739135 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.739278 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.739428 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.739574 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.739716 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.739865 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.740009 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.740158 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.740311 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.740527 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.740765 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.741024 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.741261 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.741479 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.741710 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.741953 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.742175 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.742410 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.742641 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.742809 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.742989 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.743203 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.743349 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.743504 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.743661 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.743827 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.743972 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.744114 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.744257 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.744400 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.744543 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.744694 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.744840 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.744990 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.745134 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.745276 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.745432 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.745593 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.745739 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.745933 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.746085 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.746228 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.746371 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.746525 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.746670 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.746821 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.746973 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.749458 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.749714 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.749899 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.750053 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.750197 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.750340 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.751548 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.752793 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.752951 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.753104 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.753249 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.753399 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.753543 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.754360 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.754534 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.754682 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.754826 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.754969 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.755120 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.755273 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.755418 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.755568 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.755711 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.755855 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.756007 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.756153 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.756296 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.756450 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.756593 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.756735 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.756890 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.757036 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.757178 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.757321 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.757464 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.757606 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.757760 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.757927 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.758074 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.758218 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.758371 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.758532 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.758741 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.758921 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.759085 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.759251 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.759409 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.759573 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.759749 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.759996 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.760155 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.760306 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.760453 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.760622 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.760773 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.760921 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.761078 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.761230 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.761377 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.761537 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.761687 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.761857 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.762015 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.762164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.762312 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.762472 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.762633 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.762780 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.762928 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.763075 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.763075 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.763366 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.763513 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.763669 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.763818 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.763973 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.764140 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.764297 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.764465 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.764613 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.764759 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.764906 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.765061 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.765216 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.765365 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.765511 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.765658 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.765812 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.766027 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.766178 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.766325 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.766491 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.766639 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.766799 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.766947 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.767094 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.767241 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.767396 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.767546 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.767702 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.767702 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.767983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.768129 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.768286 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.768433 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.768602 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.768756 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.768904 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.768904 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.769198 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.769427 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.769580 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.769727 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.769892 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.770136 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.770303 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.770464 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.770615 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.770770 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.770919 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.771073 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.771230 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.771379 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.771526 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.771526 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.771813 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.771961 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.772118 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.772282 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.772461 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.772630 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.772779 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.772926 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.773082 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.773082 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.773376 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.773530 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.773764 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.774049 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.774218 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.774915 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.775079 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.775079 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.775427 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.775584 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.775734 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.775883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.776029 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.776176 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.776337 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.776563 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.777304 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.777304 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.778676 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.778955 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.779111 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.779111 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.779495 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.779647 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.779796 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.779796 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.780075 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.780331 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.780331 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.780767 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.781047 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.781047 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.781361 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.781519 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.781721 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.781907 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.781907 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.782207 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.782363 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.782363 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.782644 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.782798 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.782798 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783111 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783261 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783261 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783559 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783708 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783855 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783855 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783855 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783855 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783855 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783855 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.783855 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.784888 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.785037 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.785037 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.785037 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.785037 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.785037 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.785037 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.785037 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.785037 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.786218 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.786218 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.786218 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.786218 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.786805 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.786954 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.787101 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.787257 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.787415 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.787563 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.787563 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.787841 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.787988 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.788134 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.788290 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.788439 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.788597 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.788744 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.788890 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.789046 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.789204 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.789351 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.789499 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.789653 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.789810 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.789810 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.790777 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.790931 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.791091 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.791239 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.791387 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.791546 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.791695 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.791842 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.791989 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.792135 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.792135 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.792422 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.792578 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.792726 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.792872 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.793033 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.793189 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.793337 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.793483 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.793630 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.793777 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.793998 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.794169 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.794318 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.794466 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.794612 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.794760 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.794907 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.794907 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.795205 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.795352 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.795508 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.795656 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.795812 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.795969 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.796117 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.796263 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.796410 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.796555 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.796710 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.796860 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.797023 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.797178 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.797326 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.797479 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.797640 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.797788 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.797962 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.798110 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.798257 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.798414 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.798571 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.798727 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.798886 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.799033 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.799189 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.799347 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.799508 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.799657 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.799870 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.800102 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.800291 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.800459 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.800609 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.800782 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.801256 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.801424 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.801571 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.801793 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.801995 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.802154 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.802302 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.802449 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.802605 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.802762 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.802918 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.803074 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.803223 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.803382 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.803543 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.803691 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.803838 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.803985 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.804132 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.804279 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.804435 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.804584 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.804730 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.804878 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.805024 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.805179 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.805350 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.805536 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.805690 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.805837 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.806008 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.806156 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.806326 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.806326 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.806615 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.806763 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.806916 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.807076 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.807225 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.807392 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.807540 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.807687 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.807841 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.807997 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.808146 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.808293 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.808439 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.808585 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.808738 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.808894 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.809042 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.809198 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.809345 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.809492 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.809648 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.809796 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.809964 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.809964 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.810255 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.810403 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.810557 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.810713 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.810864 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.811019 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.811177 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.811424 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.811594 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.811744 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.811891 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.812037 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.812190 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.812338 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.812494 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.812644 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.812791 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.812939 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.813133 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.813300 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.813450 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.813598 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.813746 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.813927 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.814082 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.814241 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.814390 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.814536 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.814684 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.814840 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.814988 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.815154 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.815303 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.815456 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.815456 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.815736 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.815891 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.816039 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.816185 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.816332 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.816478 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.816664 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.816826 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.816990 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.817137 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.817285 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.817432 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.817579 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.817734 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.817902 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.818056 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.818204 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.818351 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.818498 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.818656 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.818814 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.818910 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.818981 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819063 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819153 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819238 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819319 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819401 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819481 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819562 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819651 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819734 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819815 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819895 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.819976 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820057 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820146 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820229 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820310 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820391 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820472 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820561 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820659 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820743 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820914 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.820996 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.821114 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.821205 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.821275 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.821355 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.821509 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.821602 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.821699 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.821784 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.821924 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.822050 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.822176 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.822303 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.822441 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.822570 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.822696 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.822832 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.822959 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823105 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823234 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823321 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823404 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823484 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823565 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823658 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823742 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823823 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823904 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.823985 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.824066 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.824155 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.824239 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.824319 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.824469 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.824624 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.824775 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.824948 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.825082 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.825267 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.825394 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.825580 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.825715 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.825947 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.826263 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.826577 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.826889 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.827201 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.827513 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.827829 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.827970 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.828137 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.828269 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.828446 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.828577 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.828760 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.828891 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.829074 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.829205 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.829399 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.829531 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.829726 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.829907 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.830116 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.830256 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.830441 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.830570 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.830767 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.830897 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.831104 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.831231 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.831415 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.831553 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.831728 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.831855 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.832040 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.832262 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.832394 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.832586 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.832725 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.833979 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.834077 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.834163 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.834244 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.834315 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:10:33.834385 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.834385 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.834385 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.834578 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.835019 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.835113 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.835405 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.835722 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.836046 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.836349 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.836680 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.837525 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.837904 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.838185 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.838518 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.838833 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.839147 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.839463 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.839779 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.840095 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.840413 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.840745 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.841073 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.841382 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.841715 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.842063 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.842388 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.842708 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.843023 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.843353 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.843666 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.843983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.844296 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.844611 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.844926 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.845246 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.845559 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.845937 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.846553 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.846880 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.847213 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.847562 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.847860 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.848194 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.848527 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.848877 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.849197 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.849539 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.849888 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.850211 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.850527 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.850835 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:10:33.851079 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:10:33.991609 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO dbcounter [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Registered counter for database nova_api Aug 31 00:10:34.010969 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO dbcounter [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Registered counter for database nova_api Aug 31 00:10:34.014221 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_db.sqlalchemy.engines [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:10:34.021322 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writer thread running {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:10:34.031883 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_db.sqlalchemy.engines [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:10:34.039511 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writer thread running {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:10:34.081767 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.context [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65d8cb8b-7487-4666-acd5-7eed526c0edf(cell1) {{(pid=106715) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:10:34.085546 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_concurrency.lockutils [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:10:34.086040 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_concurrency.lockutils [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:10:34.088241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_concurrency.lockutils [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:10:34.088972 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_concurrency.lockutils [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:10:34.089398 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_concurrency.lockutils [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:10:34.091396 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_concurrency.lockutils [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:10:34.093416 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO dbcounter [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Registered counter for database nova_cell0 Aug 31 00:10:34.097592 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO dbcounter [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Registered counter for database nova_cell1 Aug 31 00:10:34.101986 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.context [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65d8cb8b-7487-4666-acd5-7eed526c0edf(cell1) {{(pid=106716) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:10:34.104891 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_db.sqlalchemy.engines [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:10:34.106086 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:10:34.106730 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:10:34.107450 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_db.sqlalchemy.engines [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:10:34.108826 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:10:34.109725 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:10:34.110402 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:10:34.112567 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writer thread running {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:10:34.112773 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:10:34.114959 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO dbcounter [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Registered counter for database nova_cell0 Aug 31 00:10:34.115303 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writer thread running {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:10:34.119760 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO dbcounter [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Registered counter for database nova_cell1 Aug 31 00:10:34.130840 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_db.sqlalchemy.engines [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:10:34.131650 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_db.sqlalchemy.engines [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:10:34.139392 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writer thread running {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:10:34.140845 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writer thread running {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:10:34.265629 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO dbcounter [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Registered counter for database nova_cell0 Aug 31 00:10:34.273831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG oslo_db.sqlalchemy.engines [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:10:34.278407 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writer thread running {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:10:34.287286 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO dbcounter [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Registered counter for database nova_cell0 Aug 31 00:10:34.296429 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_db.sqlalchemy.engines [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:10:34.301726 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writer thread running {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:10:34.620855 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: WARNING keystonemiddleware.auth_token [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:10:34.621465 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: WARNING keystonemiddleware.auth_token [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:10:34.628310 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: WARNING keystonemiddleware.auth_token [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:10:34.628649 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: WARNING keystonemiddleware.auth_token [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:10:34.980190 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: WARNING keystonemiddleware.auth_token [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:10:34.980683 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: WARNING keystonemiddleware.auth_token [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:10:34.986278 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: WARNING keystonemiddleware.auth_token [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:10:34.986682 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: WARNING keystonemiddleware.auth_token [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:10:34.991653 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cc8ee279c0 pid: 106715 (default app) Aug 31 00:10:34.992127 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cc8ee279c0 pid: 106716 (default app) Aug 31 00:10:34.994316 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:10:34.995509 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-15252a8b-e127-4237-a3be-0fc55a85ab2b None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002343 Aug 31 00:10:34.995917 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Wed Aug 31 00:10:34 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:11:52.764712 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:11:52.765870 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Aug 31 00:11:52.766365 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:11:52.782285 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writing DB stats nova_api:SELECT=3 {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:52.783251 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writing DB stats nova_cell0:SELECT=3 {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:52.784280 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writing DB stats nova_cell1:SELECT=3 {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:52.785428 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:53.664643 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-b5b2e54e-ef9c-4fd2-9eb7-aec8ba1092ec admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:11:53.702072 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-b5b2e54e-ef9c-4fd2-9eb7-aec8ba1092ec admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928964 Aug 31 00:11:53.705991 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 31 00:11:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:11:56.072982 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:11:56.074697 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-7044b38a-713c-492d-a293-d3c05db93015 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001847 Aug 31 00:11:56.075268 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 2/4] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:11:56.529944 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-47f50ed7-7f9d-44fb-8294-206525b2bd2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "ram": 256, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:11:56.577065 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-47f50ed7-7f9d-44fb-8294-206525b2bd2f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495766 Aug 31 00:11:56.577809 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 3/5] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:11:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:11:56.591164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_api:SELECT=3 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:56.591967 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_cell1:SELECT=3 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:56.592687 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_cell0:SELECT=3 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:56.593405 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_cell0:SELECT=3 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:56.798193 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-1f537d75-ad08-460d-a4b2-22dcf73d9d58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:11:56.867926 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-1f537d75-ad08-460d-a4b2-22dcf73d9d58 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280276 Aug 31 00:11:56.868559 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 3/6] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 31 00:11:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:11:59.234699 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-47f50ed7-7f9d-44fb-8294-206525b2bd2f admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:11:59.235708 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-47f50ed7-7f9d-44fb-8294-206525b2bd2f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 31 00:11:59.236107 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 4/7] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:11:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:11:59.879492 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-bbe71695-31fd-47d4-a811-b90125744240 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:11:59.920745 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-bbe71695-31fd-47d4-a811-b90125744240 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.677735 Aug 31 00:11:59.921949 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 4/8] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:11:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:11:59.934976 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-d7dda12a-8a2c-4338-862f-2bcf1d5dfddd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:11:59.971804 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-d7dda12a-8a2c-4338-862f-2bcf1d5dfddd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040933 Aug 31 00:11:59.973208 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 5/9] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 31 00:11:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:12:02.326513 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-bbe71695-31fd-47d4-a811-b90125744240 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:02.327562 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-bbe71695-31fd-47d4-a811-b90125744240 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 31 00:12:02.327965 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:02.730212 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-4c7181a5-87b1-46ce-bcfd-570eca671170 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "swap": 0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:02.750038 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-4c7181a5-87b1-46ce-bcfd-570eca671170 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415419 Aug 31 00:12:02.750587 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 6/11] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:12:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:12:02.762472 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-c0492c4d-bfc9-4bae-9ab4-49142b20a01d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:02.787522 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-c0492c4d-bfc9-4bae-9ab4-49142b20a01d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028668 Aug 31 00:12:02.788219 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 6/12] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 31 00:12:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:12:05.142301 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-4c7181a5-87b1-46ce-bcfd-570eca671170 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:05.143449 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-4c7181a5-87b1-46ce-bcfd-570eca671170 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Aug 31 00:12:05.144377 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 7/13] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:05.611277 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-56dc0fee-1038-45d7-a393-9e6b45a8ccfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "disk": 10}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:05.631379 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-56dc0fee-1038-45d7-a393-9e6b45a8ccfc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480875 Aug 31 00:12:05.632688 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 7/14] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:12:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:12:05.650823 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-85556ccf-990e-4a81-b0d2-b3c9880cb8e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:05.675570 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-85556ccf-990e-4a81-b0d2-b3c9880cb8e9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033047 Aug 31 00:12:05.676515 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 8/15] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 31 00:12:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:12:08.031698 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-56dc0fee-1038-45d7-a393-9e6b45a8ccfc admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:08.033499 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-56dc0fee-1038-45d7-a393-9e6b45a8ccfc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Aug 31 00:12:08.034092 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 8/16] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:08.464155 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-738c5455-4637-4a92-b6ba-dae5857168f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "name": "ds4G", "swap": 0, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:08.483405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-738c5455-4637-4a92-b6ba-dae5857168f9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443252 Aug 31 00:12:08.484140 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 9/17] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:12:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:12:08.496357 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-83903b39-eb9f-46db-b269-3de57bf2fe3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:08.521302 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-83903b39-eb9f-46db-b269-3de57bf2fe3a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028733 Aug 31 00:12:08.522054 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 9/18] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 31 00:12:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:12:10.910348 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-738c5455-4637-4a92-b6ba-dae5857168f9 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:10.911631 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-738c5455-4637-4a92-b6ba-dae5857168f9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002438 Aug 31 00:12:10.912128 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 10/19] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:11.358434 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-769ba000-c939-4872-b0c2-38d1cebc09be admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:11.383730 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-769ba000-c939-4872-b0c2-38d1cebc09be admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465416 Aug 31 00:12:11.384269 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 10/20] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 31 00:12:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:12:13.805290 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-738c5455-4637-4a92-b6ba-dae5857168f9 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:13.806383 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-738c5455-4637-4a92-b6ba-dae5857168f9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 31 00:12:13.806784 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 11/21] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:14.307008 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-d2a5fe00-ba62-4e1a-abc9-5a799ac9a066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "disk": 1}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:14.329492 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-d2a5fe00-ba62-4e1a-abc9-5a799ac9a066 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.516101 Aug 31 00:12:14.331232 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 11/22] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:12:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:12:14.344543 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-27d29768-12a8-4c96-bc9a-4b74ce94d941 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:14.374331 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-27d29768-12a8-4c96-bc9a-4b74ce94d941 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033210 Aug 31 00:12:14.375084 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 12/23] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 31 00:12:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:12:16.805235 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-d2a5fe00-ba62-4e1a-abc9-5a799ac9a066 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:16.806217 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-d2a5fe00-ba62-4e1a-abc9-5a799ac9a066 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 31 00:12:16.806614 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:17.261179 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-89e36e29-f975-4da9-beae-013f57679d03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "disk": 20, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:17.284441 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-89e36e29-f975-4da9-beae-013f57679d03 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471006 Aug 31 00:12:17.285035 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 13/25] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:12:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:12:17.296875 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-8aca8e8c-5d98-4a67-aca0-fa6e69e9fe46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:17.322855 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-8aca8e8c-5d98-4a67-aca0-fa6e69e9fe46 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029518 Aug 31 00:12:17.323728 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 13/26] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 31 00:12:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:12:19.718563 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-89e36e29-f975-4da9-beae-013f57679d03 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:19.719564 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-89e36e29-f975-4da9-beae-013f57679d03 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 31 00:12:19.719978 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:20.250114 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-ca30af47-1e95-43aa-9c3f-c1350adf88e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "disk": 40}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:20.278311 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-ca30af47-1e95-43aa-9c3f-c1350adf88e4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.550622 Aug 31 00:12:20.279161 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 14/28] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:12:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:12:20.291173 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-c44a6756-d680-4d93-970f-f541afc75da8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:20.318212 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-c44a6756-d680-4d93-970f-f541afc75da8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030519 Aug 31 00:12:20.318787 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 15/29] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 31 00:12:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:12:22.747612 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-ca30af47-1e95-43aa-9c3f-c1350adf88e4 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:22.749277 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-ca30af47-1e95-43aa-9c3f-c1350adf88e4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002098 Aug 31 00:12:22.749685 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:23.193596 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-7a85b4cb-99bb-484f-8374-5bb7aced8cf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "ram": 8192, "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "disk": 80}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:23.199907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:23.217423 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-7a85b4cb-99bb-484f-8374-5bb7aced8cf6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460928 Aug 31 00:12:23.218243 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 16/31] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:12:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:12:23.231079 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-ac4be005-c54d-4db0-84ec-8ad6d0e58037 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:23.256984 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-ac4be005-c54d-4db0-84ec-8ad6d0e58037 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029678 Aug 31 00:12:23.273734 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 16/32] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 31 00:12:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:12:25.617817 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-7a85b4cb-99bb-484f-8374-5bb7aced8cf6 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:25.618963 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-7a85b4cb-99bb-484f-8374-5bb7aced8cf6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 31 00:12:25.619463 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:26.155881 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-2eb42f3a-d816-4986-a1bd-31b6e67b50d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "id": "5"}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:26.175663 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-2eb42f3a-d816-4986-a1bd-31b6e67b50d1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.549990 Aug 31 00:12:26.176359 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 17/34] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 31 00:12:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:12:26.188966 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-b9d04744-a800-4135-a67d-7f8203b0fec3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:26.215128 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-b9d04744-a800-4135-a67d-7f8203b0fec3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030417 Aug 31 00:12:26.215829 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 18/35] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 31 00:12:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:12:45.630656 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-2eb42f3a-d816-4986-a1bd-31b6e67b50d1 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:45.631653 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-2eb42f3a-d816-4986-a1bd-31b6e67b50d1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 31 00:12:45.632054 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 18/36] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:12:45.643007 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:46.024562 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-b9c4a055-0097-4f89-a271-d85b474ad109 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:46.042405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-b9c4a055-0097-4f89-a271-d85b474ad109 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404348 Aug 31 00:12:46.042943 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 31 00:12:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:12:47.095725 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-2eb42f3a-d816-4986-a1bd-31b6e67b50d1 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:47.096717 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-2eb42f3a-d816-4986-a1bd-31b6e67b50d1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Aug 31 00:12:47.097120 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 19/38] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:47.628573 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-47076198-f534-4d5d-a436-838b2e876c01 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:47.634165 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.wsgi [None req-47076198-f534-4d5d-a436-838b2e876c01 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-47076198-f534-4d5d-a436-838b2e876c01 admin admin] Request method failure captured: Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Accept: application/json Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Accept-Encoding: gzip, deflate Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Connection: keep-alive Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Content-Length: 0 Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Host: 10.222.0.49 Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Openstack-Api-Version: compute 2.90 Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Openstack-System-Scope: None Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: User-Agent: python-novaclient Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Auth-Token: gAAAAABjDqd-Cn1J3ePg1fIou8VX4kcLhmOgctOBoVtg08n3Fozxy-9kE-Gta5oRylyyivDYmZEHEHvv60EZ4ZS3Y4yrMuTOOxCMvTTVcOMWKT1QZrl3Nv_RTpKwHmiwhjxCWlenb13mtkrDkNYYoB6hUiaIEc6Cq8t0k3z8Gm8GwCHgYUA0nqw Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Domain-Id: None Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Domain-Name: None Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Identity-Status: Confirmed Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Is-Admin-Project: True Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Domain-Id: default Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Domain-Name: Default Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Name: admin Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Role: member,reader,admin Aug 31 00:12:47.637405 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Roles: member,reader,admin Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd522a8547c94161b0d64079ee82f079"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Tenant: admin Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Tenant-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Tenant-Name: admin Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User: admin Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Domain-Id: default Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Domain-Name: Default Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Id: 35b61985750d49d482576c7757bd67fa Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Name: admin Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: method: > Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: exception: Flavor 42 could not be found. Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: action_args: {'id': '42'} Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:12:47.638907 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:47.639831 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.641241 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-47076198-f534-4d5d-a436-838b2e876c01 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:12:47.643191 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-47076198-f534-4d5d-a436-838b2e876c01 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.399280 Aug 31 00:12:47.643191 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 31 00:12:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:47.648934 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-9723f139-ce46-4e46-9086-980dceb63da3 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:47.653118 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:47.672074 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-9723f139-ce46-4e46-9086-980dceb63da3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026654 Aug 31 00:12:47.672900 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 31 00:12:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:12:47.682383 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-775fe1b9-2b3c-4679-b4e6-363e8513fdbf admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:47.706548 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-775fe1b9-2b3c-4679-b4e6-363e8513fdbf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027667 Aug 31 00:12:47.707066 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 31 00:12:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:12:47.716284 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-8641f42c-d174-49e2-8800-8777c2e16267 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:47.722368 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.wsgi [None req-8641f42c-d174-49e2-8800-8777c2e16267 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-8641f42c-d174-49e2-8800-8777c2e16267 admin admin] Request method failure captured: Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Accept: application/json Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Accept-Encoding: gzip, deflate Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Connection: keep-alive Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Content-Length: 0 Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Host: 10.222.0.49 Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Openstack-Api-Version: compute 2.90 Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Openstack-System-Scope: None Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: User-Agent: python-novaclient Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Auth-Token: gAAAAABjDqd-Cn1J3ePg1fIou8VX4kcLhmOgctOBoVtg08n3Fozxy-9kE-Gta5oRylyyivDYmZEHEHvv60EZ4ZS3Y4yrMuTOOxCMvTTVcOMWKT1QZrl3Nv_RTpKwHmiwhjxCWlenb13mtkrDkNYYoB6hUiaIEc6Cq8t0k3z8Gm8GwCHgYUA0nqw Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Domain-Id: None Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Domain-Name: None Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Identity-Status: Confirmed Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Is-Admin-Project: True Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Domain-Id: default Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Domain-Name: Default Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Name: admin Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Role: member,reader,admin Aug 31 00:12:47.725581 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Roles: member,reader,admin Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd522a8547c94161b0d64079ee82f079"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Tenant: admin Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Tenant-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Tenant-Name: admin Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User: admin Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Domain-Id: default Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Domain-Name: Default Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Id: 35b61985750d49d482576c7757bd67fa Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Name: admin Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: method: > Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: exception: Flavor 42 could not be found. Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: action_args: {'id': '42'} Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:12:47.727167 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:47.728100 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:47.729426 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-8641f42c-d174-49e2-8800-8777c2e16267 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:12:47.730683 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-8641f42c-d174-49e2-8800-8777c2e16267 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014187 Aug 31 00:12:47.730683 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 31 00:12:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:48.686992 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-775fe1b9-2b3c-4679-b4e6-363e8513fdbf admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:48.687985 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-775fe1b9-2b3c-4679-b4e6-363e8513fdbf admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 31 00:12:48.688929 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 22/43] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:49.206773 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-6bb56220-9b15-463e-b3c3-c0ba2a4e6733 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:49.212159 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.wsgi [None req-6bb56220-9b15-463e-b3c3-c0ba2a4e6733 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-6bb56220-9b15-463e-b3c3-c0ba2a4e6733 admin admin] Request method failure captured: Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Accept: application/json Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Accept-Encoding: gzip, deflate Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Connection: keep-alive Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Content-Length: 0 Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Host: 10.222.0.49 Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Openstack-Api-Version: compute 2.90 Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Openstack-System-Scope: None Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: User-Agent: python-novaclient Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Auth-Token: gAAAAABjDqeAseeZouACJX4lihp2xlLJUPFhq3x_GPpXza6w9cb34Evu5T0cHaQqd_noFNovCbrHwQ7yNU2bc4zsTQoj8Ppsm6L65oxGDFdOgt_PVsJRTANJdLaegbl4zL4MT1S47Dh_uRR8oYEMm-UYjZZkVMPgph_BNYRTmgcNEAak-oFUKoU Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Domain-Id: None Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Domain-Name: None Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Identity-Status: Confirmed Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Is-Admin-Project: True Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Domain-Id: default Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Domain-Name: Default Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Name: admin Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Role: member,reader,admin Aug 31 00:12:49.213632 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Roles: member,reader,admin Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd522a8547c94161b0d64079ee82f079"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Tenant: admin Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Tenant-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Tenant-Name: admin Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User: admin Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Domain-Id: default Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Domain-Name: Default Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Id: 35b61985750d49d482576c7757bd67fa Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Name: admin Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: method: > Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: exception: Flavor 84 could not be found. Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: action_args: {'id': '84'} Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:12:49.215164 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:49.216039 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.217132 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-6bb56220-9b15-463e-b3c3-c0ba2a4e6733 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:12:49.218243 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-6bb56220-9b15-463e-b3c3-c0ba2a4e6733 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389375 Aug 31 00:12:49.218243 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 31 00:12:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:49.225046 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-8ee4f7a0-904f-4377-b729-7b106417b12a admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:49.240390 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-8ee4f7a0-904f-4377-b729-7b106417b12a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018869 Aug 31 00:12:49.240906 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 31 00:12:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:12:49.250503 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-38ba087a-86ba-4935-91af-7d6086a9bc61 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:49.265062 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-38ba087a-86ba-4935-91af-7d6086a9bc61 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018446 Aug 31 00:12:49.265573 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 31 00:12:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:12:49.275075 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-bdce8a1b-908c-4f1c-8834-b25dbf9ce2aa admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:49.280249 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.wsgi [None req-bdce8a1b-908c-4f1c-8834-b25dbf9ce2aa admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-bdce8a1b-908c-4f1c-8834-b25dbf9ce2aa admin admin] Request method failure captured: Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Accept: application/json Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Accept-Encoding: gzip, deflate Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Connection: keep-alive Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Content-Length: 0 Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Host: 10.222.0.49 Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Openstack-Api-Version: compute 2.90 Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Openstack-System-Scope: None Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: User-Agent: python-novaclient Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Auth-Token: gAAAAABjDqeAseeZouACJX4lihp2xlLJUPFhq3x_GPpXza6w9cb34Evu5T0cHaQqd_noFNovCbrHwQ7yNU2bc4zsTQoj8Ppsm6L65oxGDFdOgt_PVsJRTANJdLaegbl4zL4MT1S47Dh_uRR8oYEMm-UYjZZkVMPgph_BNYRTmgcNEAak-oFUKoU Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Domain-Id: None Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Domain-Name: None Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Identity-Status: Confirmed Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Is-Admin-Project: True Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Domain-Id: default Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Domain-Name: Default Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Name: admin Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Role: member,reader,admin Aug 31 00:12:49.281712 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Roles: member,reader,admin Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd522a8547c94161b0d64079ee82f079"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Tenant: admin Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Tenant-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Tenant-Name: admin Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User: admin Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Domain-Id: default Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Domain-Name: Default Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Id: 35b61985750d49d482576c7757bd67fa Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Name: admin Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: method: > Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: exception: Flavor 84 could not be found. Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: action_args: {'id': '84'} Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:12:49.283638 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:49.284490 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:49.285803 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-bdce8a1b-908c-4f1c-8834-b25dbf9ce2aa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:12:49.286888 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-bdce8a1b-908c-4f1c-8834-b25dbf9ce2aa admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011992 Aug 31 00:12:49.286888 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 24/47] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 31 00:12:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:50.255854 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-38ba087a-86ba-4935-91af-7d6086a9bc61 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:50.256862 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-38ba087a-86ba-4935-91af-7d6086a9bc61 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 31 00:12:50.257289 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 24/48] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:12:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:50.772768 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-765dca59-5a71-4a2d-b4d6-6ae11b4cd2db admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:50.778391 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.wsgi [None req-765dca59-5a71-4a2d-b4d6-6ae11b4cd2db admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-765dca59-5a71-4a2d-b4d6-6ae11b4cd2db admin admin] Request method failure captured: Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Accept: application/json Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Accept-Encoding: gzip, deflate Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Connection: keep-alive Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Content-Length: 0 Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Host: 10.222.0.49 Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Openstack-Api-Version: compute 2.90 Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Openstack-System-Scope: None Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: User-Agent: python-novaclient Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Auth-Token: gAAAAABjDqeC0o8o2-Vrz4fuwTQo78KBSd8xfxzNLvybKigQC9AaJfD07vQWOcup1b0koLaDTByIl7EVt4L50wfb6ZHz1g8HuAs-Fv2YJkzcWS5GmzvXB9Rtg45xO0jWnXqHMCU3Vx-95IXlZo5TjqPdeTQM5oqzM0hOaNVxRae5Rfljrh9uinY Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Domain-Id: None Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Domain-Name: None Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Identity-Status: Confirmed Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Is-Admin-Project: True Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Domain-Id: default Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Domain-Name: Default Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Project-Name: admin Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Role: member,reader,admin Aug 31 00:12:50.779883 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Roles: member,reader,admin Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd522a8547c94161b0d64079ee82f079"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Tenant: admin Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Tenant-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-Tenant-Name: admin Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User: admin Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Domain-Id: default Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Domain-Name: Default Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Id: 35b61985750d49d482576c7757bd67fa Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: X-User-Name: admin Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: method: > Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: exception: Flavor 451 could not be found. Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: action_args: {'id': '451'} Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:12:50.781455 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:50.782589 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.783897 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-765dca59-5a71-4a2d-b4d6-6ae11b4cd2db admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:12:50.785126 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-765dca59-5a71-4a2d-b4d6-6ae11b4cd2db admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386790 Aug 31 00:12:50.785126 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 31 00:12:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:50.790774 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-ce3d7ab0-b2f2-4c91-96d9-e0d535cf4d17 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:50.806085 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-ce3d7ab0-b2f2-4c91-96d9-e0d535cf4d17 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018808 Aug 31 00:12:50.806606 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 25/50] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 31 00:12:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:12:50.816272 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:50.831014 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018866 Aug 31 00:12:50.831537 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 26/51] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 31 00:12:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:12:50.840409 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-182ead43-9b98-439e-9fc6-bd0006e82157 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:50.845460 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.wsgi [None req-182ead43-9b98-439e-9fc6-bd0006e82157 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-182ead43-9b98-439e-9fc6-bd0006e82157 admin admin] Request method failure captured: Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Accept: application/json Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Accept-Encoding: gzip, deflate Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Connection: keep-alive Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Content-Length: 0 Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Host: 10.222.0.49 Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Openstack-Api-Version: compute 2.90 Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Openstack-System-Scope: None Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: User-Agent: python-novaclient Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Auth-Token: gAAAAABjDqeC0o8o2-Vrz4fuwTQo78KBSd8xfxzNLvybKigQC9AaJfD07vQWOcup1b0koLaDTByIl7EVt4L50wfb6ZHz1g8HuAs-Fv2YJkzcWS5GmzvXB9Rtg45xO0jWnXqHMCU3Vx-95IXlZo5TjqPdeTQM5oqzM0hOaNVxRae5Rfljrh9uinY Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Domain-Id: None Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Domain-Name: None Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Identity-Status: Confirmed Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Is-Admin-Project: True Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Domain-Id: default Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Domain-Name: Default Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Project-Name: admin Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Role: member,reader,admin Aug 31 00:12:50.846983 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Roles: member,reader,admin Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd522a8547c94161b0d64079ee82f079"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd522a8547c94161b0d64079ee82f079"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Tenant: admin Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Tenant-Id: bd522a8547c94161b0d64079ee82f079 Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-Tenant-Name: admin Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User: admin Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Domain-Id: default Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Domain-Name: Default Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Id: 35b61985750d49d482576c7757bd67fa Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: X-User-Name: admin Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: method: > Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: exception: Flavor 451 could not be found. Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: action_args: {'id': '451'} Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:12:50.848551 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:50.849529 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: ERROR nova.api.openstack.wsgi Aug 31 00:12:50.851001 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-182ead43-9b98-439e-9fc6-bd0006e82157 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:12:50.852241 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-182ead43-9b98-439e-9fc6-bd0006e82157 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011345 Aug 31 00:12:50.852241 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 26/52] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 31 00:12:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:51.833012 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:51.834085 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 31 00:12:51.834522 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:52.354865 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-2835325c-f670-48ba-b37f-106cf41e71b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:52.373754 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-2835325c-f670-48ba-b37f-106cf41e71b3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400901 Aug 31 00:12:52.374317 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 27/54] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 31 00:12:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:12:53.330249 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:53.331253 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 00:12:53.331648 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:53.851578 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-e06bcb6e-29d5-4bbc-a072-43c6603bc629 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:53.870572 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-e06bcb6e-29d5-4bbc-a072-43c6603bc629 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403645 Aug 31 00:12:53.871120 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 28/56] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 31 00:12:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:12:54.847070 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:54.848072 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 31 00:12:54.848463 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:12:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:55.369244 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-0c7878b0-555c-4246-9d7e-695d8259d735 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:55.388834 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-0c7878b0-555c-4246-9d7e-695d8259d735 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.400120 Aug 31 00:12:55.389368 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 29/58] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 31 00:12:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:12:56.352713 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:56.353747 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 31 00:12:56.354174 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 30/59] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:56.866314 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-97395a37-7a9d-40a2-9615-478bc02c98e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:12:56.885097 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-97395a37-7a9d-40a2-9615-478bc02c98e2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.395136 Aug 31 00:12:56.885641 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 30/60] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 31 00:12:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:12:57.847437 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:57.848440 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 31 00:12:57.848888 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 31/61] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:12:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:12:58.367695 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-a430ff57-e052-425d-8fcf-16504e23ab3a admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:12:58.389696 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-a430ff57-e052-425d-8fcf-16504e23ab3a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401073 Aug 31 00:12:58.389696 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 31/62] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Aug 31 00:12:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:13:51.573685 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:51.574730 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-95676f6b-aab9-454a-abcc-d6a6e700a707 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 31 00:13:51.575130 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 31 00:13:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:13:51.585579 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:51.962398 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-849104f9-305b-49f6-91a3-f43aa2fb1b07 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:51.982088 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-849104f9-305b-49f6-91a3-f43aa2fb1b07 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400907 Aug 31 00:13:51.982617 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 32/64] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 31 00:13:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:13:52.003596 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG dbcounter [-] [106715] Writing DB stats nova_api:SELECT=14 {{(pid=106715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:52.007619 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-3296d63d-39fe-4557-91b2-85a0adeb1309 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:52.015071 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-3296d63d-39fe-4557-91b2-85a0adeb1309 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012895 Aug 31 00:13:52.015575 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 33/65] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 31 00:13:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:52.027344 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-0213e0d5-a934-459b-87ea-b5d93042fd2b admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:52.034800 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-0213e0d5-a934-459b-87ea-b5d93042fd2b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010983 Aug 31 00:13:52.035312 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 33/66] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 31 00:13:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:13:52.046114 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:52.053815 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011122 Aug 31 00:13:52.054370 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 34/67] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 31 00:13:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:13:52.066042 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-2dbf7373-34df-4fef-8851-bd5ce2409753 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:13:52.073414 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-2dbf7373-34df-4fef-8851-bd5ce2409753 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011369 Aug 31 00:13:52.073959 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 34/68] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 31 00:13:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:16:53.388952 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:16:53.390023 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 31 00:16:53.390430 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 35/69] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:16:53.541738 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_api:SELECT=6 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:53.700893 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-b96fe5b1-57bb-4bac-b450-1df8de11005f admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:16:53.704310 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-b96fe5b1-57bb-4bac-b450-1df8de11005f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:16:53.704783 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-b96fe5b1-57bb-4bac-b450-1df8de11005f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:16:53.705212 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-b96fe5b1-57bb-4bac-b450-1df8de11005f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:16:53.705950 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-b96fe5b1-57bb-4bac-b450-1df8de11005f admin admin] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:16:53.706395 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-b96fe5b1-57bb-4bac-b450-1df8de11005f admin admin] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:16:53.706809 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-b96fe5b1-57bb-4bac-b450-1df8de11005f admin admin] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:16:53.740484 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-b96fe5b1-57bb-4bac-b450-1df8de11005f admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200103 Aug 31 00:16:53.741034 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 35/70] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 31 00:16:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:16:54.571109 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:16:54.572157 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 31 00:16:54.572549 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:16:54.758830 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-cdc254ac-1958-4f66-a1ad-b7b448a33031 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:16:54.762858 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-cdc254ac-1958-4f66-a1ad-b7b448a33031 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:16:54.763329 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-cdc254ac-1958-4f66-a1ad-b7b448a33031 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:16:54.763754 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-cdc254ac-1958-4f66-a1ad-b7b448a33031 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:16:54.764486 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-cdc254ac-1958-4f66-a1ad-b7b448a33031 admin admin] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:16:54.764929 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-cdc254ac-1958-4f66-a1ad-b7b448a33031 admin admin] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:16:54.765342 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-cdc254ac-1958-4f66-a1ad-b7b448a33031 admin admin] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:16:54.784905 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-cdc254ac-1958-4f66-a1ad-b7b448a33031 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076182 Aug 31 00:16:54.785393 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 36/72] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 31 00:16:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:17:06.007013 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:17:06.008046 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 31 00:17:06.008443 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 37/73] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:17:06.150959 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_cell0:SELECT=4 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:06.152111 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_cell1:SELECT=4 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:06.152795 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG dbcounter [-] [106716] Writing DB stats nova_api:SELECT=8 {{(pid=106716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:06.199578 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-d4dd445f-4933-44d9-93cc-c9015f686b5a admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:17:06.202991 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-d4dd445f-4933-44d9-93cc-c9015f686b5a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:17:06.203466 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-d4dd445f-4933-44d9-93cc-c9015f686b5a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:17:06.203895 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-d4dd445f-4933-44d9-93cc-c9015f686b5a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:17:06.204611 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-d4dd445f-4933-44d9-93cc-c9015f686b5a admin admin] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:17:06.205055 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-d4dd445f-4933-44d9-93cc-c9015f686b5a admin admin] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:17:06.205474 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-d4dd445f-4933-44d9-93cc-c9015f686b5a admin admin] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:17:06.231055 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-d4dd445f-4933-44d9-93cc-c9015f686b5a admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084596 Aug 31 00:17:06.231605 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 37/74] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 31 00:17:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:17:07.052108 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: DEBUG nova.api.openstack.wsgi [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] Calling method '>' {{(pid=106715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:17:07.053111 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: INFO nova.api.openstack.requestlog [None req-4859e5b6-846f-4e35-a641-24562945c366 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 31 00:17:07.053510 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: [pid: 106715|app: 0|req: 38/75] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 31 00:17:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:17:07.246297 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG nova.api.openstack.wsgi [None req-adae8a9e-a894-4a42-9c44-197129575a56 admin admin] Calling method '>' {{(pid=106716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:17:07.249605 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-adae8a9e-a894-4a42-9c44-197129575a56 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:17:07.250099 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-adae8a9e-a894-4a42-9c44-197129575a56 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:17:07.250518 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-adae8a9e-a894-4a42-9c44-197129575a56 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:17:07.251223 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-adae8a9e-a894-4a42-9c44-197129575a56 admin admin] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:17:07.251663 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-adae8a9e-a894-4a42-9c44-197129575a56 admin admin] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:17:07.252070 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: DEBUG oslo_concurrency.lockutils [None req-adae8a9e-a894-4a42-9c44-197129575a56 admin admin] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:17:07.274571 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: INFO nova.api.openstack.requestlog [None req-adae8a9e-a894-4a42-9c44-197129575a56 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080742 Aug 31 00:17:07.275440 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: [pid: 106716|app: 0|req: 38/76] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 31 00:17:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:18:04.209204 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: Wed Aug 31 00:18:04 2022 - graceful shutdown triggered... Aug 31 00:18:04.209765 dv-cinder-852209-8-iscsi devstack@n-api.service[106715]: Gracefully killing worker 1 (pid: 106715)... Aug 31 00:18:04.210192 dv-cinder-852209-8-iscsi devstack@n-api.service[106716]: Gracefully killing worker 2 (pid: 106716)... Aug 31 00:18:04.211519 dv-cinder-852209-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 00:18:05.210418 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: worker 1 buried after 1 seconds Aug 31 00:18:05.210418 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: worker 2 buried after 1 seconds Aug 31 00:18:05.210418 dv-cinder-852209-8-iscsi devstack@n-api.service[106714]: goodbye to uWSGI. Aug 31 00:18:05.211928 dv-cinder-852209-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 00:18:05.212484 dv-cinder-852209-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 00:18:05.215319 dv-cinder-852209-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 00:18:05.224798 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:18:05 2022] *** Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: nodename: dv-cinder-852209-8-iscsi Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: machine: x86_64 Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: clock source: unix Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: pcre jit disabled Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: detected number of CPU cores: 4 Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: current working directory: / Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:18:05.227837 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: your processes number limit is 47680 Aug 31 00:18:05.228553 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: your memory page size is 4096 bytes Aug 31 00:18:05.228553 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: detected max file descriptor number: 2048 Aug 31 00:18:05.228553 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: lock engine: pthread robust mutexes Aug 31 00:18:05.228553 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: thunder lock: enabled Aug 31 00:18:05.228553 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 00:18:05.228553 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:18:05.269946 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: Python main interpreter initialized at 0x55daa42fd9c0 Aug 31 00:18:05.269946 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: python threads support enabled Aug 31 00:18:05.269946 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: your server socket listen backlog is limited to 100 connections Aug 31 00:18:05.269946 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:18:05.270381 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:18:05.270381 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: *** Operational MODE: preforking *** Aug 31 00:18:05.270674 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:18:05.270821 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: spawned uWSGI master process (pid: 132180) Aug 31 00:18:05.271146 dv-cinder-852209-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 00:18:05.273304 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: spawned uWSGI worker 1 (pid: 132200, cores: 1) Aug 31 00:18:05.278805 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: spawned uWSGI worker 2 (pid: 132201, cores: 1) Aug 31 00:18:05.278805 dv-cinder-852209-8-iscsi devstack@n-api.service[132180]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:18:05.940458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:18:05.944293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:18:07.110187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:18:07.110187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: from cryptography.utils import int_from_bytes Aug 31 00:18:07.110920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:18:07.110920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: from cryptography.utils import int_from_bytes Aug 31 00:18:07.113159 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:18:07.113159 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: from cryptography.utils import int_from_bytes Aug 31 00:18:07.113613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:18:07.113613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: from cryptography.utils import int_from_bytes Aug 31 00:18:09.509009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:18:09.509697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:18:09.509798 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:18:09.510182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:18:09.510434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:18:09.510829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.511156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.511480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.511810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.512292 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.512612 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.512937 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.513257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.513587 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.513874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.514190 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.514520 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-8-iscsi {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.514846 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.515159 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.515474 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.515794 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.516101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.516427 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.516736 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.517239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.519000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.519316 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.519640 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.520008 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.520311 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.520624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.520948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.521265 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.521592 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.521931 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.522343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-8-iscsi {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.522666 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.522977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.523288 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.523709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.524627 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.524917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.525248 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.525594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.525903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.526232 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.526554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.526873 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.527193 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.527501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.527801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.528111 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.528229 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:18:09.528667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:18:09.528749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.528749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.529042 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:18:09.529144 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.529299 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.529392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:18:09.529534 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:18:09.529633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.529885 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.530013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.530205 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.530315 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.530528 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.530640 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.530793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.530898 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.531044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.531342 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.531508 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.531684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.531917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.532074 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.532222 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.532405 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.532560 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.532714 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.532866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.533020 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.533175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.533320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.533471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.533615 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.533771 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-8-iscsi {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.533960 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.534115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.534267 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.534428 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.534572 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.534725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.534884 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.535028 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.535179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.535382 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.535544 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.535718 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.535870 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.536025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.536176 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.536176 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.536517 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.536700 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.536852 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.536852 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.537135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.537279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.537438 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.537438 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.537745 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.537950 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.538148 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.538317 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.538464 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.538615 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.538796 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.538953 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.539098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.539258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.539404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.539555 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.539747 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.541034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.542110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-8-iscsi {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.542293 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.542453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.542660 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.542813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.542958 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.543102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.543246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.543246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.543529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.543677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.543927 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.544088 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.544233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.544388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.544551 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.544708 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.544861 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.545013 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.545156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.545309 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.545309 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.545599 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.545754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.545949 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.546101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.546264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.546418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.546572 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.547303 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.547471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.547628 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.547788 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.547947 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.548098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.548300 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.548453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.548606 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.548760 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.548923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.549077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.549221 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.549622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.549782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.549963 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.550679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.550842 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.551027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.551486 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.551650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.551803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.551971 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.552126 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.552280 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.552430 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.552582 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.552726 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.553095 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.553262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.553410 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.553554 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.553697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.553870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.554142 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.554527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.554692 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.554851 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.555013 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.555179 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.555482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.555745 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.555896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.556049 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.556194 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.556337 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.556493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.556655 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.556812 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.556956 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.557107 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.557252 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.557414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.557566 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.557710 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.557925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.558087 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.558087 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.558414 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.558566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.558729 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.558880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.559025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.559182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.559335 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.559480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.559622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.559765 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.559914 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.560067 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.560238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.560781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.560953 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.561100 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.561244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.561397 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.561655 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.561806 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.561987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.562148 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.562306 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.562460 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.562613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.562764 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.562915 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.563069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.563233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.563378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.563523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.563666 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.563820 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.563972 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.564226 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.564457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.564607 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.564758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.564902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.565044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.565212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.565365 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.565508 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.565659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.565803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.565803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.566128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.566279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.566430 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.566580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.566743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.566896 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.567050 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.567203 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.567355 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.567509 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.568117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.568284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.568450 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.568671 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.568821 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.568972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.569124 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.569326 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.569472 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.569636 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.569788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.569968 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.570128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.570280 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.570431 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.572233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.572409 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.572566 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.572714 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.572867 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.573025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.573184 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.574537 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.574802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.574964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.575121 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.575273 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.575431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.575583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.575727 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.575882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.576027 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.576171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.576328 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.576474 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.576644 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.576801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.576955 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.577106 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.577261 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.577416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.577560 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.577713 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.577876 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.578040 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.578195 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.578403 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.578559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.578722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.578875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.579064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.579231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.579378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.579529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.579726 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.579915 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.580076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.580230 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.580382 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.580525 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.580719 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.581053 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.581213 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.581408 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.581571 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.581764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.582060 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.582261 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.582437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.582688 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.582840 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.582840 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.583173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:18:09.583336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.583493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.583647 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.583797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.583942 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.584092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.584236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.584392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.584545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.584689 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.584860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.585089 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.585238 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.585400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.585547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.585690 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.585856 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.586009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.586166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.586324 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.586475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.587180 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.587326 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.587479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.587639 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.587794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.587947 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.588091 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.588234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.588234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.588521 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.588673 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.588824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.588968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.589110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.589260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.589412 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.590026 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.590201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.590356 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.590507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.590652 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.590810 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.590975 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.591202 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.591352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.591352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.591633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.591785 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.591930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.592073 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.592235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.592388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.592546 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.592709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.592950 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.593101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.593259 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.593404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.593562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.593707 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.593878 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.594041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.594196 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.594346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.594498 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.594643 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.594787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.594931 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.594931 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.595397 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.595548 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.595701 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.595845 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.595996 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.596140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.596311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.596463 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.596614 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.596768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.596920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.597081 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.597241 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.597386 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.597536 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.597687 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.597941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.598096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.598267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.598465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.598627 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.598774 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.598925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.599079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.599235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.599388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.599533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.599676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.599819 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.599971 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.600116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.600260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.600468 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.600613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.600764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.600918 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.601070 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.601232 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.601447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.601604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.601757 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.601961 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.606000 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.606189 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.606348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.606524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.606685 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.606845 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.607001 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.607149 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.607296 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.607441 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.607604 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.607760 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.607906 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.608059 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.608204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.608357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.608554 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.608803 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.609056 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.609301 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.609541 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.609785 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.610187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.610448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.610678 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.610842 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.611001 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.611155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.611321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.611485 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.611721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.611873 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.612016 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.612168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.612314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.612457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.612599 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.612743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.612886 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.613045 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.613198 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.613353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.613498 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.613649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.613808 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.613992 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.614146 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.614289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.614289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.614568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.614712 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.614870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.615016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.615160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.615314 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.615458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.615610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.615755 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.615905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.616176 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.616481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.616721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.616984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.617227 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.617532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.617813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.618133 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.618392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.618657 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.618908 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.619159 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.619368 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.619519 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.619664 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.619819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.619972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.620117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.620279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.620438 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.620614 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.620800 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.620959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.621121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.621275 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.621432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.621593 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.621835 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622331 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.622480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.623487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.623644 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.623644 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.623935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.624099 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.624259 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.624409 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.624559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.624725 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.624875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.625023 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.625186 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.625336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.625494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.625652 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.625808 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.625995 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.626177 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.626347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.626499 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.626792 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.626969 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.627749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.627924 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.628079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.628079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.628079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.628079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.628079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.628079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.628079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.628079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.629323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.629495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.629657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.629808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.629996 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.630160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.630318 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.630469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.630633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.630793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.630944 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.631093 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.631243 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.631401 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.631649 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.631832 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.632068 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.632232 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.632383 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.632541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.632707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.632858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.633007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.633171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.633867 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.634048 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.634201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.634373 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.634532 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.634683 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.634884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.635056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.635215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.635366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.635589 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.635589 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.635890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.636055 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.636257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.636410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.636586 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.636746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.636899 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.637056 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.637207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.637365 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.637529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.637707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.638096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.638262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.638453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.638453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.638777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.638777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.639153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.639314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.639465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.639622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.639783 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.639934 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.640085 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.640234 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.640390 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.640550 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.640709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.640879 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.641080 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.641295 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.641452 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.641611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.641778 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.641954 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.642227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.642227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.642535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.642743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.642909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.643115 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.643289 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.643448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.643599 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.643759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.643910 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.644113 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.644317 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.644478 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.644674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.644832 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.644993 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.645153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.645366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.645541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.645703 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.645899 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.646057 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.646209 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.646361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.646510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.646677 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.646836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.646988 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.647144 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.647295 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.647470 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.647622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.647781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.647932 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.648089 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.648240 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.648398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.648559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.648709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.648709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.649058 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.649716 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.649902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.650071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.650229 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.650387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.650539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.650689 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.650854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.651012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.651170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.651332 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.651482 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.651633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.651792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.651951 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.652112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.652349 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.652505 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.652667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.652827 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.652978 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.652978 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.653277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.653437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.653602 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.653754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.653940 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.654096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.654257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.654408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.654571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.654733 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.654892 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.655043 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.655192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.655352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.655504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.655660 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.655838 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.656175 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.656175 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.656497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.656656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.656809 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.656967 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.657119 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.657270 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.657466 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.657627 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.657789 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.657975 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.658129 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.658287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.658463 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.658616 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.658616 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.658910 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.659061 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.659217 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.659381 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.659539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.659699 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.659851 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.660009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.660174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.660325 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.660325 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.660630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.660802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.660802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.661609 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.661764 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.661952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.662116 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.662268 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.662513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.662692 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.662852 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.662852 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.663160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.663319 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.663503 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.664216 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.664389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.664542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.664802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.664959 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.665157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.665312 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.665463 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.665660 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.665824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.666056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.666221 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.666375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.666527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.666685 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.666850 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.667008 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.667160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.667311 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.667468 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.667634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.667792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.667961 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.668112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.668262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.668419 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.668584 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.668852 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.669025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.669187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.669347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.669506 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.669671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.669830 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.670016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.670178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.670330 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.670488 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.670654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.670806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.670963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.671114 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.671270 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.671439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.671607 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.671759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.671908 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.672064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.672234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.672485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.672715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.672871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.673030 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.673180 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.673331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.673331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.673632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.673782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.673993 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.674155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.674307 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.674737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.674889 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.675048 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.675207 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.675366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.675526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.675711 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.675909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.676062 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.676211 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.676369 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.676696 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.676847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.677012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.677170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.677327 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.677491 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.677650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.677802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.677986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.677986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.678281 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.678447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.678605 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.678773 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.678933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.679083 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.679242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.679393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.679542 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.679692 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.679848 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.679848 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.680151 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.680331 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.680489 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.680647 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.680820 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.680979 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.681139 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.681297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.681481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.681632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.681789 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.681993 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.682155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.682315 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.682466 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.682622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.682858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.683041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.683193 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.683344 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.683494 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.683652 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.683803 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.683961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.684114 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.684270 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.684420 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.684570 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.684719 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.684893 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.685086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.685197 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.685288 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.685375 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.685493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.685493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.685690 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.685789 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.685909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686096 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686178 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686252 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686324 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686535 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686609 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686687 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686847 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.686920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687013 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687203 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687371 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687463 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687558 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687651 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.687905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688097 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688184 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688276 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688446 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688645 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688732 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688816 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.688907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689100 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689194 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689288 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689381 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689653 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.689932 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690213 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690744 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.690995 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691179 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691278 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691627 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.691917 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692275 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692370 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692457 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692816 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.692980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693147 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693238 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693334 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693427 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693606 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693901 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.693991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694232 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694314 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694567 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694661 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694736 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694870 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.694947 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.695422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.695522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.695610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.695610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.695762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.695762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.696397 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.696397 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.696540 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.696622 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.696696 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.696696 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.696843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.696917 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697165 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697334 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697416 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697497 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697570 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697791 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.697919 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698335 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698496 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698654 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698727 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.698957 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699030 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699108 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699260 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699623 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699779 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699861 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.699941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700021 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700247 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700324 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700557 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700658 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700740 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700825 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700899 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.700970 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701048 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701133 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701292 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701541 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701615 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701835 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.701944 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702031 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702105 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702176 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702477 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702557 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702636 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702915 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.702990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703264 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703746 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703835 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.703926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.704720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.705534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.705534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.705534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.705734 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.705932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.706065 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.706234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.706484 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.706671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.706843 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.706999 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.707166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.707326 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.707488 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.707654 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.707880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.708044 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.708207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.708370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.708523 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.708685 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.708857 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.709021 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.709185 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.709339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.709492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.709654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.709814 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.710005 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.710160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.710325 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.710479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.710714 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.710986 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.711157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.711319 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.711528 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.712188 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.712362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.712525 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.712679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.712831 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.712984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.713136 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.713295 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.713451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.713611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.713765 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.714059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.714251 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.714421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.714574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.714727 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.714888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.715042 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.715247 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.715562 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.715724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.715887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.715887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.716284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.716448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.716622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.716783 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.716935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.717088 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.717240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.717409 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.717563 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.717725 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.718013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.718176 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.718347 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.718347 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.718660 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.718815 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.718967 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.718967 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.719279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.719441 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.719602 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.719756 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.719909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.720078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.720289 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.720537 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.720863 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.721127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.721127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.722348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.722530 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.722696 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.722850 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.723004 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.723157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.723318 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.723479 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.723640 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.723808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.723965 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.724129 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.724303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.724457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.724608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.724761 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.724913 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.725066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.725228 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.725432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.725432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.725917 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.726086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.726353 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.726525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.726687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.726848 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.727001 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.727193 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.727357 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.727511 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.727511 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.727801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.727962 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.728124 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.728290 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.728464 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.728626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.728787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.728940 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.729106 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.729270 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.729423 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.729582 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.729742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.729949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.730117 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.730281 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.730443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.730611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.730765 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.730917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.731080 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.731233 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.731394 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.731555 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.731720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.731874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.731874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.732182 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.732336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.732488 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.732658 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.732819 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.732819 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.733126 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.733279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.733431 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.733583 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.733735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.733919 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.734078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.734231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.734392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.734561 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.734723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.734884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.735045 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.735205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.735366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.735366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.735860 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.736023 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.736185 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.736366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.736616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.736776 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.736950 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.737112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.737112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.737403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.737556 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.737556 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.737874 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.738035 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.738188 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.738351 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.738505 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.738669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.738834 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.738996 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.739157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.739311 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.739311 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.739624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.739780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.739933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.740085 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.740246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.740408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.740642 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.740798 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.740971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.741136 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.741298 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.741466 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.741630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.741793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.742037 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.742194 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.742194 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.742498 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.742660 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.742850 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.743027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.743187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.743352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.743506 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.743659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.743815 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.743976 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.744137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.744299 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.744460 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.744614 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.744774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.744939 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.745092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.745259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.745420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.745624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.745950 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.746127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.746293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.746455 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.746739 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.746903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.747067 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.747242 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.747406 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.747561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.747713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.747867 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.747867 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.748165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.748328 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.748482 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.748634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.748634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.748939 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.749108 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.749279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.749440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.749601 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.749762 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.749762 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.750141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.750296 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.750459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.750612 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.750764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.750916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.751098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.751399 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.751566 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.751723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.751885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.752047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.752211 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.752375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.752375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.752674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.752834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.752997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.753152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.753304 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.753469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.753622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.753774 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.753965 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.754120 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.754272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.754426 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.754596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.754750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.754750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.755056 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.755215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.755377 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.755553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.755759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.756055 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.756219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.756383 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.756383 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.756692 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.756967 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.757128 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.757282 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.757444 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.757598 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.757763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.757977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.757977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.758273 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.759051 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.759051 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.759377 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.759547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.759710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.759863 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.760023 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.760185 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.760338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.760515 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.760669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.760822 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.760974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.761143 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.761312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.761560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.761728 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.761903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.762074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.762243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.762412 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.762566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.762738 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.762892 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.762892 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.763190 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.763353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.763353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.763660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.763814 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.763966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.764127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.764288 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.764450 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.764621 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.764775 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.764928 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.765094 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.765248 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.765400 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.765553 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.765705 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.765941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.766132 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.766367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.766526 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.766686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.766850 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.767115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.767289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.767443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.767596 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.767759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.767914 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.768081 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.768236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.768236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.768540 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.768694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.768694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.769006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.769162 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.769313 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.769466 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.769618 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.769771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.769961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.770119 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.770271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.770431 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.770584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.770744 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.770922 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.771076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.771229 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.771382 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.771555 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.771868 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.772029 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.772191 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.772345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.772499 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.772651 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.772819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.772819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:18:09.773154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.773154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.773154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.773154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.773154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.773154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.773154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.775311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.775311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.775311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.775311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.775311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.776085 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.776085 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.776401 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.776860 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.777184 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.777504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.777937 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.778163 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.778483 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.778802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.779120 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.779439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.779756 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.780079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.780430 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.780762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.781305 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.781637 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.781990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.782311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.782631 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.782952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.783271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.783596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.783934 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.784257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.784570 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.785125 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.785456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.785790 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.786174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.786685 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.787074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.787412 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.788380 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.788724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.789050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.789784 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.790157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.791282 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.791624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.791937 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.792261 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.792584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.792917 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.793239 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.793556 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.793915 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.794212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.794528 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.794844 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.795271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.795595 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.795924 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.796290 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.796666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.797119 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.797440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.797756 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.798098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.798419 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.798735 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.799264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.799854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.800170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.800509 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.800854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.801318 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.801652 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.802028 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.802356 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.802689 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.803008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.803341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.803675 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.804004 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.804321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.804661 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.805068 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.805433 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.805755 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.806137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.806425 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.806856 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.807331 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.807675 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.807992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.808327 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.808655 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.808982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.809305 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.809625 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.809996 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.810320 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.810640 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.811060 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.811523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.811849 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.812174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.812496 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.812812 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.813137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.813459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.813794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.814157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.814478 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.814813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.815255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.815624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.815953 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.816306 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.816725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.817047 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.817497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.818466 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:18:09.818748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:18:09.832790 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO dbcounter [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Registered counter for database nova_api Aug 31 00:18:09.854542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_db.sqlalchemy.engines [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:18:09.861501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writer thread running {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:18:09.902597 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO dbcounter [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Registered counter for database nova_api Aug 31 00:18:09.918773 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.context [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65d8cb8b-7487-4666-acd5-7eed526c0edf(cell1) {{(pid=132200) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:18:09.922818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:09.922989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_db.sqlalchemy.engines [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:18:09.923296 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:09.925180 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:09.926034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:09.926392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:09.928466 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:09.931004 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO dbcounter [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Registered counter for database nova_cell0 Aug 31 00:18:09.932218 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writer thread running {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:18:09.935069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO dbcounter [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Registered counter for database nova_cell1 Aug 31 00:18:09.942231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_db.sqlalchemy.engines [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:18:09.944441 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_db.sqlalchemy.engines [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:18:09.950507 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writer thread running {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:18:09.952518 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writer thread running {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:18:09.990425 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.context [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65d8cb8b-7487-4666-acd5-7eed526c0edf(cell1) {{(pid=132201) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:18:09.995133 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:09.995620 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:09.997245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:09.998024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:18:09.998478 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:18:10.000491 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:18:10.002558 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO dbcounter [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Registered counter for database nova_cell0 Aug 31 00:18:10.006670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO dbcounter [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Registered counter for database nova_cell1 Aug 31 00:18:10.015107 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_db.sqlalchemy.engines [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:18:10.016094 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_db.sqlalchemy.engines [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:18:10.022743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writer thread running {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:18:10.025362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writer thread running {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:18:10.099811 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO dbcounter [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Registered counter for database nova_cell0 Aug 31 00:18:10.106323 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_db.sqlalchemy.engines [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:18:10.110642 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writer thread running {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:18:10.172279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO dbcounter [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Registered counter for database nova_cell0 Aug 31 00:18:10.181805 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_db.sqlalchemy.engines [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:18:10.186315 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writer thread running {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:18:10.425336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: WARNING keystonemiddleware.auth_token [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:18:10.432590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: WARNING keystonemiddleware.auth_token [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:18:10.504054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: WARNING keystonemiddleware.auth_token [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:18:10.511903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: WARNING keystonemiddleware.auth_token [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:18:10.774567 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: WARNING keystonemiddleware.auth_token [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:18:10.781445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: WARNING keystonemiddleware.auth_token [None req-4f811f45-5135-4f95-88c1-371a1204623a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:18:10.786898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55daa42fd9c0 pid: 132200 (default app) Aug 31 00:18:10.862034 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: WARNING keystonemiddleware.auth_token [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:18:10.868689 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: WARNING keystonemiddleware.auth_token [None req-4dcbe821-8483-4299-a39f-c298937996d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:18:10.874110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55daa42fd9c0 pid: 132201 (default app) Aug 31 00:19:02.504712 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=3 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:02.510404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=3 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:02.513775 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=3 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:02.515875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=3 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:04.547089 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-978611901", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:04.595706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=3 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:04.597330 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=3 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:04.601327 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=3 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:04.602400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=3 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:06.416420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f2227b2a-8de9-4c08-ade0-b5ea5acdb4e7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'create', calling method: .version_select at 0x7fcd70d7ae50>, body: {"keypair": {"name": "tempest-keypair-728332430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr93T+/bwFZ674UJoMFJmQE6suTocxPQ5eDt8P41zo4ebuBwhsgmC74aHYB+NU252oFYw+4uyYjS6+uoJd3hdmJbA+zx2b2tNihkjx3bInehV79l6DTx9fEtjbDmT0Dtg=="}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:06.558990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-f2227b2a-8de9-4c08-ade0-b5ea5acdb4e7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Getting quotas for project eed416bd0f5f4e2e8453db6ff35f6ac5. Resources: {'key_pairs'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:19:06.579902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-f2227b2a-8de9-4c08-ade0-b5ea5acdb4e7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Getting quotas for user a76438b57a2140cca853e0e71fb28f64 and project eed416bd0f5f4e2e8453db6ff35f6ac5. Resources: {'key_pairs'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:19:06.732592 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f2227b2a-8de9-4c08-ade0-b5ea5acdb4e7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 2.144023 Aug 31 00:19:06.743300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 1/1] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 31 00:19:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 2155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:06.799644 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.network.neutron [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] validate_networks() for [('b08e6dcc-55d3-4b2c-af3f-6bba850da199', None, None, None, None, None)] {{(pid=132200) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:19:07.778041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f7e2d612-dfec-4cbb-a63b-16bc1a0df9f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'create', calling method: .version_select at 0x7fcd70be3430>, body: {"keypair": {"name": "tempest-keypair-239562019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMQNa4hghcTAi6zWf62HINkVUPmy/0T0mRdHfQqWjmYuJ6IRhquoeaSGUyc1LJqpPgwd/a9q6Qg2kfpBl3hu5eZTCqWd2lQUQgsi1Wt32qPrerghEhPnEA5SJXwBOx6ig=="}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:07.834792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-f7e2d612-dfec-4cbb-a63b-16bc1a0df9f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Getting quotas for project 74bc2aed79de4b3d92d19ef9bf26cc51. Resources: {'key_pairs'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:19:07.845506 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-f7e2d612-dfec-4cbb-a63b-16bc1a0df9f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Getting quotas for user 3f519b1d9a1149169b8142e738320a89 and project 74bc2aed79de4b3d92d19ef9bf26cc51. Resources: {'key_pairs'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:19:07.911479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f7e2d612-dfec-4cbb-a63b-16bc1a0df9f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.571191 Aug 31 00:19:07.912529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 2/2] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:19:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:08.435613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1027676753", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "networks": [{"uuid": "a2857ccd-eafa-4cd5-ad42-84b94f0d327d"}]}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:09.441526 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Flavor limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:19:09.442236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Image limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:19:09.442755 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Flavor pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:19:09.443278 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Image pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:19:09.443765 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:19:09.484227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:09.484723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:09.489413 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:09.490323 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:09.490804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:09.491276 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:09.586454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Getting quotas for project 0043c999ad9d451ab45c19cbea1765ea. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:19:09.607552 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Getting quotas for user c924dfe7e9c941f9b7110c1a440633dc and project 0043c999ad9d451ab45c19cbea1765ea. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:19:09.629291 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Going to run 1 instances... {{(pid=132200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:19:09.638026 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:19:09.939974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-886de437-0275-4e63-8273-a20f002f291e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.441356 Aug 31 00:19:09.948512 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:19:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 7453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:19:09.966252 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-da53a272-641d-46ff-99b1-49a68305309d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:09.968096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-da53a272-641d-46ff-99b1-49a68305309d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:10.009329 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] validate_networks() for [('a2857ccd-eafa-4cd5-ad42-84b94f0d327d', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:19:10.342918 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-da53a272-641d-46ff-99b1-49a68305309d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:10.420247 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-da53a272-641d-46ff-99b1-49a68305309d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1221 microversion: 2.1 time: 0.467847 Aug 31 00:19:10.440455 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:09 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1221 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:10.747263 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1908212579", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:10.880591 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.network.neutron [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] validate_networks() for [('b08e6dcc-55d3-4b2c-af3f-6bba850da199', None, None, None, None, None)] {{(pid=132200) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:19:12.251361 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Flavor limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:19:12.251939 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Image limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:19:12.252575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Flavor pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:19:12.253179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Image pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:19:12.254130 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:19:12.273145 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:12.274067 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:12.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:12.275870 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:12.277126 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:12.277823 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:12.307301 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Getting quotas for project 0043c999ad9d451ab45c19cbea1765ea. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:19:12.313365 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Getting quotas for user c924dfe7e9c941f9b7110c1a440633dc and project 0043c999ad9d451ab45c19cbea1765ea. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:19:12.329784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Going to run 1 instances... {{(pid=132200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:19:12.334021 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:19:12.489230 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ec55f1ba-e3c0-4c86-a4b3-60ceba634bbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.747635 Aug 31 00:19:12.491226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 3/5] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:19:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:19:12.500701 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-204930365", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fde66121-8958-431f-b529-f1f260e01ad8"}], "security_groups": [{"name": "tempest-securitygroup--1335496488"}], "key_name": "tempest-keypair-728332430", "user_data": "}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:12.543907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:19:12.544455 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:19:12.545034 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:19:12.545196 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:19:12.545652 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:19:12.576556 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:12.577071 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:12.577509 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:12.578313 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:12.579287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:12.590768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:12.669368 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Getting quotas for project 258e6d65abf74a58af993ca946d98798. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:19:12.677583 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Getting quotas for user ced4ad031f324edb89eff6133fbf9543 and project 258e6d65abf74a58af993ca946d98798. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:19:12.707564 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:19:12.711211 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:19:12.822664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.network.neutron [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] validate_networks() for [('fde66121-8958-431f-b529-f1f260e01ad8', None, None, None, None, None)] {{(pid=132200) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:19:12.880183 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b4727d24-f9f9-4ddb-9771-5456d6c91a1d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.965850 Aug 31 00:19:12.882235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 3/6] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:19:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:19:12.907253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a6f7c63e-1287-4951-b104-9c001dd1ec7a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:12.908825 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a6f7c63e-1287-4951-b104-9c001dd1ec7a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:13.236535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a6f7c63e-1287-4951-b104-9c001dd1ec7a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:13.278299 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a6f7c63e-1287-4951-b104-9c001dd1ec7a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1222 microversion: 2.1 time: 0.394433 Aug 31 00:19:13.304152 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:12 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1222 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:13.320394 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d72e9d29-f18e-45ce-b8aa-4c24f766e970 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:13.329290 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d72e9d29-f18e-45ce-b8aa-4c24f766e970 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:13.457610 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d72e9d29-f18e-45ce-b8aa-4c24f766e970 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:13.481826 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d72e9d29-f18e-45ce-b8aa-4c24f766e970 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1215 microversion: 2.1 time: 0.175371 Aug 31 00:19:13.482447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:13 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:13.528670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1922590097", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f176d24e-2d9c-4a88-9bef-bf72b1c486af"}], "security_groups": [{"name": "tempest-securitygroup--2141762215"}], "key_name": "tempest-keypair-239562019", "user_data": "}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:13.702807 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] validate_networks() for [('f176d24e-2d9c-4a88-9bef-bf72b1c486af', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:19:14.226936 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Flavor limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:19:14.227484 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Image limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:19:14.231249 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Flavor pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:19:14.232909 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Image pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:19:14.232909 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:19:14.271096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:14.275882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:14.276465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:14.281240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:14.289496 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:14.290021 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:14.354225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Getting quotas for project eed416bd0f5f4e2e8453db6ff35f6ac5. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:19:14.366016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Getting quotas for user a76438b57a2140cca853e0e71fb28f64 and project eed416bd0f5f4e2e8453db6ff35f6ac5. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:19:14.406880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Going to run 1 instances... {{(pid=132200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:19:14.409329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:19:14.531272 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-dfb67ede-9071-417f-a51b-c6e520819fd3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.037204 Aug 31 00:19:14.531912 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 4/9] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 31 00:19:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 00:19:14.542157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:14.542782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:14.560617 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:14.561108 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:14.561546 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:14.565573 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:14.566086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:14.566526 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:14.721762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:19:14.723440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:19:14.724153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:19:14.724930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:19:14.725598 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:19:14.744980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:14.745826 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:14.747052 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:14.750435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:14.751196 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:14.757290 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:14.857370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Getting quotas for project 74bc2aed79de4b3d92d19ef9bf26cc51. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:19:14.871422 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Getting quotas for user 3f519b1d9a1149169b8142e738320a89 and project 74bc2aed79de4b3d92d19ef9bf26cc51. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:19:14.900590 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:19:14.903993 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:19:14.936656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:14.974329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e6729d42-151d-4b7e-8013-1d6089623ac8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1226 microversion: 2.1 time: 0.432284 Aug 31 00:19:14.974329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:14 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1226 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:14.978319 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:14.980586 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:14.990734 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:14.997261 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:14.998097 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e48e345b-addd-4256-b9ce-dbf837eb4c9d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.474199 Aug 31 00:19:14.998255 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:14.998878 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 6/11] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:19:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:19:15.006920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:15.007426 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:15.008433 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-73a8bc7e-5166-4674-aa40-9107cd9837c4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:15.009439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-73a8bc7e-5166-4674-aa40-9107cd9837c4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:15.011710 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:15.117494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-73a8bc7e-5166-4674-aa40-9107cd9837c4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:15.148611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-73a8bc7e-5166-4674-aa40-9107cd9837c4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:15.157044 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-73a8bc7e-5166-4674-aa40-9107cd9837c4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:15.168181 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-73a8bc7e-5166-4674-aa40-9107cd9837c4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1280 microversion: 2.20 time: 0.157657 Aug 31 00:19:15.170763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 7/12] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:14 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1280 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:15.175750 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-58f52225-805a-4c08-817b-ff1a0d65c8d0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:15.184836 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-58f52225-805a-4c08-817b-ff1a0d65c8d0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:15.198440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:15.207297 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0e7ce3d7-cf98-437c-a749-8b8fe6516af9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1219 microversion: 2.1 time: 0.237686 Aug 31 00:19:15.214907 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 6/13] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:14 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1219 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:15.436724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-58f52225-805a-4c08-817b-ff1a0d65c8d0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:15.445935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-58f52225-805a-4c08-817b-ff1a0d65c8d0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1237 microversion: 2.1 time: 0.274052 Aug 31 00:19:15.447010 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 8/14] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:15 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1237 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:15.992428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:15.993049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:16.015847 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:16.016539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:16.017134 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:16.018037 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:16.018673 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:16.019238 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:16.095743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:16.106684 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f8cc455e-5750-4a29-afb4-ae4db98c2fbb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1226 microversion: 2.1 time: 0.119140 Aug 31 00:19:16.107331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 7/15] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:15 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:16.192599 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:16.193280 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:16.199459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:16.200108 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:16.200950 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:16.201884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:16.202328 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:16.202752 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:16.234717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:16.235336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:16.249540 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:16.250137 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:16.250503 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:16.251367 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:16.252135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:16.252719 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:16.362788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:16.421071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e3848c4f-c8f7-422f-b751-a88b172ffd83 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1219 microversion: 2.1 time: 0.177379 Aug 31 00:19:16.422655 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:16 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1219 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:16.448699 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:16.469524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:16.470309 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:16.480753 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:16.482267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:16.483392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-84718a9c-542a-4701-8b13-2d4c98a089f8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1284 microversion: 2.20 time: 0.294756 Aug 31 00:19:16.486481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 9/17] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:16 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:16.524179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:16.525208 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:16.525662 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:16.532986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:16.537538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:16.541746 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:16.726031 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:16.745147 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5be106f6-ef4f-48e3-809d-f4f587bf571c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1241 microversion: 2.1 time: 0.275356 Aug 31 00:19:16.748468 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 9/18] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:16 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1241 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:17.129231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:17.130088 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:17.146791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:17.152777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:17.153477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:17.154759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:17.155403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:17.156043 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:17.258312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:17.279897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-092f9ae9-35f9-4beb-965a-4bf9b6cd3791 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.154520 Aug 31 00:19:17.280868 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 10/19] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:17 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:17.448956 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:17.449590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:17.457268 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:17.458135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:17.459248 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:17.460554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:17.461633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:17.462299 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:17.522518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:17.523951 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:17.534122 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:17.534634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:17.535045 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:17.536286 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:17.536841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:17.537199 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:17.609169 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:17.619280 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-026fe741-5d30-4a74-abf9-c17a2c4caff2 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.178232 Aug 31 00:19:17.620212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 10/20] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:17 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:17.623424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:17.644279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:17.646261 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:17.648067 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1b002e87-3365-4502-aa82-16c966c81574 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.134411 Aug 31 00:19:17.663170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 11/21] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:17 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:17.769011 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:17.769963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:17.776568 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:17.777549 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:17.778237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:17.779024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:17.779553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:17.780208 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:17.877821 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:17.890399 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fbbf6435-2652-4249-900c-63e420fdc676 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.124130 Aug 31 00:19:17.902005 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 11/22] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:17 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:18.303042 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:18.303673 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:18.313561 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:18.316526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:18.317236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:18.318844 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:18.319514 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:18.320178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:18.642347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:18.643805 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:18.657540 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:18.658686 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:18.661648 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:18.663196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:18.663847 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:18.665691 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:18.689466 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:18.699456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b828ee8d-66d5-4611-873a-a4927900db64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.401020 Aug 31 00:19:18.701103 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:18 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:18.708930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:18.709766 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:18.721039 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:18.721832 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:18.722473 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:18.723362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:18.724000 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:18.725278 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:18.808778 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:18.816872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9c956cb7-d356-4540-99da-f4fe1c4326de tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.179193 Aug 31 00:19:18.817455 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 12/24] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:18 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:18.863351 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:18.882158 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:18.891356 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:18.893129 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-71d5e37a-b79a-4fdb-8da0-c2cf8fa1ca99 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.190425 Aug 31 00:19:18.893933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 13/25] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:18 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:18.913556 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:18.914217 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:18.921305 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:18.921931 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:18.922420 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:18.923404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:18.924239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:18.924807 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:19.014176 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:19.056144 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-66d95f6a-0686-452c-b87e-66a9bbdb10e4 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.147307 Aug 31 00:19:19.056980 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 13/26] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:18 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:19.720865 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:19.721548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:19.728197 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:19.728685 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:19.729107 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:19.729792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:19.730272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:19.730697 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:19.791106 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:19.798898 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-37531f8d-92e6-46d7-8c36-17a6b15c98a5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.081761 Aug 31 00:19:19.799471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 14/27] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:19 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:19.840650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:19.841270 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:19.847306 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:19.847794 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:19.848235 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:19.848923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:19.849971 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:19.850406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:19.925223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:19.927597 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:19.953143 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:19.953747 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:19.955571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:19.956900 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:19.957809 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:19.958473 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:19.982453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:19.999615 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7bad0194-3ccb-41b5-a049-2f2425e85b24 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.162789 Aug 31 00:19:20.000187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 14/28] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:19 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:20.056520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:20.065059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:20.067329 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:20.069178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-47a1e28c-255d-41d7-a62f-0f81f52cc324 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.155664 Aug 31 00:19:20.069726 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 15/29] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:19 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:20.079372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:20.079992 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:20.087913 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:20.089344 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:20.100848 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:20.104271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:20.106188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:20.107643 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:20.233076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:20.245858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fc1e9d2f-11dd-40c2-a69c-171017c3ed8d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.170144 Aug 31 00:19:20.246453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 15/30] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:20 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:20.819680 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:20.820211 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:20.834364 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:20.835072 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:20.835675 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:20.836575 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:20.837535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:20.838156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:20.921426 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:20.931888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ac09105f-4d6f-4e89-843d-b8b2dfbbbb61 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.116557 Aug 31 00:19:20.932497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 16/31] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:20 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:21.020721 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:21.021667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:21.029654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:21.030554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:21.030912 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:21.031687 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:21.032238 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:21.032856 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:21.091852 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:21.092469 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:21.100361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:21.100841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:21.101289 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:21.102020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:21.102474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:21.103103 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:21.106531 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:21.114971 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-de7084f7-5c2e-43a4-8c02-42833adc3ba6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.097793 Aug 31 00:19:21.115729 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 16/32] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:21 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:21.169420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:21.177794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:21.179303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:21.180410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b6102256-9bcc-4049-ab53-74376a8bd8f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.092446 Aug 31 00:19:21.181134 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 17/33] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:21 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:21.266106 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:21.266841 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:21.273427 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:21.273939 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:21.274373 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:21.275058 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:21.275508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:21.275928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:21.348986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:21.357801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1092c304-f36d-44b6-a72a-bda126923171 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.095591 Aug 31 00:19:21.362262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 17/34] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:21 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:21.958274 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:21.959442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:21.967713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:21.968435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:21.968932 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:21.969647 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:21.970165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:21.970594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:22.034842 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:22.043103 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-618567c3-06fe-4503-9e7e-e6c590da0b5b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.088808 Aug 31 00:19:22.043661 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 18/35] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:21 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:22.135818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:22.136437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:22.142589 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:22.143209 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:22.143795 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:22.144621 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:22.145216 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:22.145816 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:22.202803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:22.203682 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:22.212945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:22.214131 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:22.215782 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:22.216256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:22.217384 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:22.217874 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:22.218310 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:22.225650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a1bfc8a8-60ad-4942-bb71-e88d4b656e75 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.093403 Aug 31 00:19:22.240562 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 18/36] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:22 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:22.288935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:22.297579 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:22.299348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:22.300468 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-dafc2b57-b90a-4ddf-b09e-075f884a11f5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.102034 Aug 31 00:19:22.301064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:22 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:22.385407 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:22.385407 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:22.386808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:22.387295 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:22.387731 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:22.388431 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:22.388881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:22.389303 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:22.451134 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:22.459575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f69a7e38-fb43-463f-9572-8c3fddce7d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.083973 Aug 31 00:19:22.460152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 19/38] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:22 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:23.065363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:23.066609 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:23.075086 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:23.075828 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:23.076435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:23.077140 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:23.077594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:23.078056 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:23.159003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:23.167981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a69d3e29-8a97-49b7-b467-caa57bf5ee9b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.107049 Aug 31 00:19:23.168869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 20/39] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:23 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:23.254610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:23.255954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:23.280669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:23.282044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:23.282813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:23.284127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:23.286499 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:23.287713 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:23.323104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:23.324010 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:23.328523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.337328 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.343725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:23.344226 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:23.344660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:23.345562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:23.348415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:23.349535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:23.437159 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:23.453796 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a324fcf8-ca79-4afe-8dfe-1f2fd068d37b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.208301 Aug 31 00:19:23.455922 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 20/40] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:23 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:23.492128 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:23.495912 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:23.498573 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:23.517916 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:23.518445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:23.519276 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:23.519905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:23.521883 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:23.522503 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:23.523300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:23.523429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:23.532801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-88782032-1333-41bd-b179-dab5c89d3b90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.212191 Aug 31 00:19:23.532801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:23 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:23.634087 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:23.643956 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c6370e52-d7d1-4ae3-90b0-9677fa698531 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.161191 Aug 31 00:19:23.644532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 21/42] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:23 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:24.197017 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:24.198931 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:24.207675 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:24.210906 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:24.212608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:24.213439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:24.215415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:24.215927 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:24.339606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:24.348005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8cc5ca2b-63ec-4f62-8000-8bae2ef693dd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.158012 Aug 31 00:19:24.348576 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 22/43] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:24 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:24.481122 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=6 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:24.481930 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=20 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:24.487716 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:24.488320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:24.499238 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:24.502295 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:24.503720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:24.506480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:24.507153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:24.509435 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:24.557803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:24.558446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:24.584123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:24.585497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:24.585984 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:24.589531 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:24.590188 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:24.590806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:24.628894 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:24.667805 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-31c8dd6b-f91a-4095-924a-bf31b25a305d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.184137 Aug 31 00:19:24.670875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 22/44] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:24 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:24.678857 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:24.680530 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:24.694336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:24.696211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:24.698355 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:24.701049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:24.702564 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:24.703442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:24.732444 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:24.742547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:24.744020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:24.748766 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0a728f81-9fdb-4596-97c2-7ddd08787d27 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.196764 Aug 31 00:19:24.760009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:24 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:24.785705 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:24.795766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-655cdff7-b783-4c1c-b099-6f0dba29599f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.121566 Aug 31 00:19:24.797111 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 23/46] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:24 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:25.372889 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:25.372889 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:25.374592 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=4 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:25.384526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:25.386850 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:25.389189 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:25.390834 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:25.397159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:25.398128 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:25.449804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=28 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:25.563146 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:25.572148 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:25.575866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4e8313ec-6a77-44c2-b7f3-ce37c8aae27e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.209205 Aug 31 00:19:25.576622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 24/47] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:25 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:25.697018 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:25.697632 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:25.703827 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:25.704553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:25.705146 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:25.706586 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:25.707052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:25.707790 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:25.773581 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:25.774452 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:25.782460 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:25.783899 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:25.784793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:25.785581 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:25.786888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:25.787349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:25.788016 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:25.793801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d235350a-d0b0-42bb-81ca-f0a2e8aa537e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.100545 Aug 31 00:19:25.795898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:25 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:25.818016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:25.818879 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:25.825531 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:25.826426 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:25.826898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:25.827935 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:25.828421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:25.828916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:25.867950 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:25.889341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:25.891382 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:25.892559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b42a5345-b485-4ca6-bd56-c71500ae3e5b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.124431 Aug 31 00:19:25.893467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:25 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:25.924006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:25.932775 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-43422749-bd4e-4345-9a16-613f93fe909e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.119805 Aug 31 00:19:25.933360 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 25/50] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:25 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:26.599491 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:26.600765 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:26.621220 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.621881 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.623282 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.638471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.638471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.638471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.744421 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:26.754443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0b5ea878-0873-4125-b5f8-da38fa820bd5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.161008 Aug 31 00:19:26.769277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 26/51] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:26 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:26.828199 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:26.828819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:26.847156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.847661 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.848102 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.848815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.849820 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.850271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.918113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:26.918754 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:26.927564 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.929995 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.930788 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.932415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.933744 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.935340 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.961839 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:26.970175 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2929b7d9-dc1e-4121-aacc-581eff06aa2a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.147034 Aug 31 00:19:26.970743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 26/52] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:26 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:26.975496 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:26.976269 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:26.981469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:26.983512 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.984331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.984917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:26.985763 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:26.986577 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:26.987504 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:27.030908 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:27.040720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:27.042356 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:27.043488 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-fe9f370e-d35d-4a34-8a05-33ff79f4bc71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.129748 Aug 31 00:19:27.044049 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 27/53] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:26 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:27.060539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:27.069234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cb594b9c-feb4-4cc8-810c-0e7dc2fe9ebf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.097330 Aug 31 00:19:27.070431 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 27/54] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:26 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:27.777870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:27.779232 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:27.785915 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:27.786747 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:27.787464 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:27.788285 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:27.788777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:27.789239 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:27.857314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:27.870226 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4bce99f6-f00e-472d-b33d-34bf360875ce tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.096756 Aug 31 00:19:27.872097 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 28/55] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:27 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:27.991749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:27.992567 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:27.999165 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:27.999976 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:28.000617 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:28.001553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:28.002115 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:28.002610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:28.068767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:28.069798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:28.077464 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:28.077971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:28.078408 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:28.079135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:28.079582 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:28.080006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:28.091866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:28.100252 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5996d9dd-05ca-4109-8cbb-14cab5c8837a tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.112927 Aug 31 00:19:28.100905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 28/56] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:27 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:28.105875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:28.106756 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:28.113704 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:28.114356 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:28.115316 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:28.116536 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:28.117077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:28.126491 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:28.178372 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:28.201678 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:28.203977 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:28.205509 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-48dc5a8e-e1b9-4b4a-8cdc-7a4cb0d71022 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.141460 Aug 31 00:19:28.206368 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 29/57] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:28 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:28.249678 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:28.265233 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ec2f5c67-bd3a-4aea-a2f2-4ce2bb4dbeeb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.157583 Aug 31 00:19:28.266374 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 29/58] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:28 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:28.893171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:28.893795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:28.900083 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:28.900573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:28.901047 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:28.901738 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:28.902221 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:28.902672 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:29.003873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:29.011638 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-83b96d3d-bdce-4cd3-9b83-d38874b65ae0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.122454 Aug 31 00:19:29.012198 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:28 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:29.121006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:29.122393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:29.128678 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:29.129151 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:29.129757 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:29.130572 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:29.131001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:29.131362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:29.203537 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:29.216066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-376ead2e-6503-4085-b122-ab8c6ef8cca4 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.098745 Aug 31 00:19:29.225878 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 30/60] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:29 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:29.235833 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:29.236487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:29.243797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:29.244784 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:29.245340 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:29.246404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:29.247020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:29.247601 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:29.287919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:29.288654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:29.294979 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:29.295658 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:29.296242 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:29.296938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:29.297776 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:29.298111 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:29.320851 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:29.328935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:29.330669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:29.332443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-023bc780-d75d-4a3d-bbfc-0f2b06dfcd9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.102239 Aug 31 00:19:29.332987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:29 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:29.363443 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:29.372096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-45a3e356-7889-4d84-ba21-2ae22ec81c95 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.088666 Aug 31 00:19:29.372665 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 31/62] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:29 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:30.031892 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:30.032508 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:30.044420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:30.045199 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:30.045818 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:30.054795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:30.055497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:30.056095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:30.172799 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:30.182413 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-374ee9c8-12ba-425e-b754-a6fecf794119 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.154641 Aug 31 00:19:30.183297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 32/63] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:30 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:30.238115 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:30.238889 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:30.248331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:30.250048 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:30.251328 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:30.252050 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:30.252498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:30.253204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:30.348843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:30.356847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:30.357712 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:30.364530 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6c98631a-97e1-460c-87ed-83bcc2163d63 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.130535 Aug 31 00:19:30.365758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:30.366518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:30.367206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:30.368143 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:30.369136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:30.369757 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:30.377885 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 32/64] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:30 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:30.396097 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:30.397021 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:30.408016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:30.408378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:30.409174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:30.410171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:30.411957 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:30.412896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:30.476693 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:30.486442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:30.488847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:30.491680 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7e0556f0-89c7-4e8d-9dac-8b8c3227e3aa tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1332 microversion: 2.20 time: 0.140127 Aug 31 00:19:30.492492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 33/65] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:30 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1332 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:30.523234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:30.533729 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0390bc21-9faf-4d07-a4ad-bc62b6e32f6a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.143203 Aug 31 00:19:30.535008 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 33/66] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:30 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:31.206726 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:31.207522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:31.218098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:31.218875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:31.219328 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:31.235769 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:31.236262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:31.236876 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:31.320723 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:31.343709 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-da548875-5ba3-4154-83c3-438fa557299a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1274 microversion: 2.1 time: 0.143258 Aug 31 00:19:31.344405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 34/67] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:31 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:31.384937 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:31.385777 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:31.392153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:31.393604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:31.394336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:31.401235 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:31.401867 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:31.402353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:31.489246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:31.503653 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0f96a139-b80b-4976-9e48-382857a6a48b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1267 microversion: 2.1 time: 0.122750 Aug 31 00:19:31.504678 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 34/68] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:31 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:31.520734 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:31.522794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:31.533547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:31.534226 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:31.535268 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:31.536816 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:31.537417 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:31.538210 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:31.557991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:31.558982 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:31.580536 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:31.581257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:31.581750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:31.582556 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:31.582936 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:31.588532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:31.690458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:31.714705 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:31.718980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:31.720527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-dc36644e-b7da-4e9a-8fa8-f86aeafb906c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1340 microversion: 2.20 time: 0.205753 Aug 31 00:19:31.724011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 35/69] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:31 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1340 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:31.775170 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:31.798338 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d9bfec4a-1ca8-4530-97e3-5920a74fd333 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1289 microversion: 2.1 time: 0.238198 Aug 31 00:19:31.799319 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 35/70] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:31 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1289 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:32.365493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:32.366790 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:32.373641 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:32.374702 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:32.375354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:32.377240 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:32.377997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:32.378822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:32.524458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:32.525074 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:32.534781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:32.535287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:32.537498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:32.538669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:32.539130 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:32.539565 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:32.625944 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:32.653456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ad6f3027-ea9c-4687-951d-75d77ea93a27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1280 microversion: 2.1 time: 0.289377 Aug 31 00:19:32.655968 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 36/71] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:32 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1280 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:32.753694 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:32.754338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:32.763730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:32.767381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:32.768090 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:32.769171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:32.771392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:32.773355 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:32.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:32.834767 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c4ed34fe-f9a3-4d2a-ad36-71124e5d1df7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1275 microversion: 2.1 time: 0.315142 Aug 31 00:19:32.852064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 36/72] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:32 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1275 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:32.863096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:32.863719 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:32.879461 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:32.880535 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:32.880979 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:32.881688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:32.882173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:32.883003 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:32.925247 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:33.047905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:33.058048 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1b05dcb6-fc59-434f-84e7-f1f0d70fa021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1295 microversion: 2.1 time: 0.204433 Aug 31 00:19:33.058843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 37/73] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:32 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:33.117517 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:33.128910 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:33.130961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:33.132082 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2c224876-1276-44cc-942c-ffba0aadf8d2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1338 microversion: 2.20 time: 0.384467 Aug 31 00:19:33.132640 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 37/74] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:32 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1338 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:33.198674 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-3616c14a-aadc-42ad-aa52-8f41e28af2ef req-8c6a20ef-5b2c-4cc3-af7b-7f20cb6a035e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b85b900-da07-4c75-b7f3-4d0681c11d3a", "tag": "91d0ea44-40c9-4a3e-b2ec-4b47827fa644"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:33.218591 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3616c14a-aadc-42ad-aa52-8f41e28af2ef req-8c6a20ef-5b2c-4cc3-af7b-7f20cb6a035e service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:33.219079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3616c14a-aadc-42ad-aa52-8f41e28af2ef req-8c6a20ef-5b2c-4cc3-af7b-7f20cb6a035e service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:33.219510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3616c14a-aadc-42ad-aa52-8f41e28af2ef req-8c6a20ef-5b2c-4cc3-af7b-7f20cb6a035e service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:33.247901 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-3616c14a-aadc-42ad-aa52-8f41e28af2ef req-8c6a20ef-5b2c-4cc3-af7b-7f20cb6a035e service nova] Creating event network-changed:91d0ea44-40c9-4a3e-b2ec-4b47827fa644 for instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a on hv-cinder-85220 Aug 31 00:19:33.248641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3616c14a-aadc-42ad-aa52-8f41e28af2ef req-8c6a20ef-5b2c-4cc3-af7b-7f20cb6a035e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132200) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 00:19:33.249230 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3616c14a-aadc-42ad-aa52-8f41e28af2ef req-8c6a20ef-5b2c-4cc3-af7b-7f20cb6a035e service nova] Acquired lock "compute-rpcapi-router" {{(pid=132200) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 00:19:33.250469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2dd0efb8-2230-4183-a212-bed1fdb6f3a3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:33.251168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2dd0efb8-2230-4183-a212-bed1fdb6f3a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:33.251668 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2dd0efb8-2230-4183-a212-bed1fdb6f3a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:33.252397 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2dd0efb8-2230-4183-a212-bed1fdb6f3a3 None None] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:33.252846 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2dd0efb8-2230-4183-a212-bed1fdb6f3a3 None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:33.253275 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2dd0efb8-2230-4183-a212-bed1fdb6f3a3 None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:33.264326 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.compute.rpcapi [None req-2dd0efb8-2230-4183-a212-bed1fdb6f3a3 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 00:19:33.265225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2dd0efb8-2230-4183-a212-bed1fdb6f3a3 None None] Releasing lock "compute-rpcapi-router" {{(pid=132200) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 00:19:33.288801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2dd0efb8-2230-4183-a212-bed1fdb6f3a3 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227602 Aug 31 00:19:33.289659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 38/75] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:33.681276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:33.682800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:33.689139 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:33.689869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:33.690494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:33.691438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:33.692431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:33.693028 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:33.792492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:33.802783 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4e775d21-dcdb-4fa5-a566-42aeca7a9e31 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1280 microversion: 2.1 time: 0.124527 Aug 31 00:19:33.804548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 38/76] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:33 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:33.882077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:33.884361 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:33.894539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:33.896089 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:33.897065 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:33.898031 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:33.899309 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:33.899798 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:34.016167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:34.027776 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ce90d5a5-f82f-42ca-95b4-fa16093c4978 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1273 microversion: 2.1 time: 0.151171 Aug 31 00:19:34.029251 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 39/77] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:33 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:34.085780 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:34.087232 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:34.094458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:34.097434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:34.098164 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:34.099546 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:34.100208 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:34.100821 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:34.162600 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:34.163326 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:34.173041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:34.174387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:34.175268 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:34.176000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:34.176628 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:34.177594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:34.316514 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:34.327921 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f33bcbc8-ec97-4e22-929c-5e3b2ca7997c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1295 microversion: 2.1 time: 0.247545 Aug 31 00:19:34.328206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 39/78] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:34 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1295 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:34.745632 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:34.762998 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:34.772541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:34.773949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-556ce7af-7d28-4919-8869-9fd947e84ef1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.619033 Aug 31 00:19:34.774849 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 40/79] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:34 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:34.827390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:34.828615 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:34.840403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:34.841732 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:34.842557 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:34.843544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:34.844537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:34.845145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:35.056759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:35.057469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:35.072011 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:35.076182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:35.080163 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:35.082275 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:35.082781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:35.086312 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:35.333203 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:35.343153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6562cf99-3532-4048-84c9-6713c63b8641 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.522409 Aug 31 00:19:35.346443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 40/80] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:34 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:35.355393 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:35.358580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:35.371743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:35.372463 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:35.377355 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:35.378405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:35.379079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:35.379714 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:35.405309 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:35.463924 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:35.480968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6a95b6d7-a93a-43d8-ab34-3551a4f860c7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.430462 Aug 31 00:19:35.497319 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 41/81] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:35 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:35.799737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:35.800675 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:35.818968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:35.819806 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:35.820458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:35.823292 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:35.824250 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:35.825195 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:36.011251 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:36.023084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4c4ee939-dccb-4e47-a429-b5c8a4777ef9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.675219 Aug 31 00:19:36.024111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 41/82] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:35 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:36.371798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:36.372793 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:36.387780 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:36.388687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:36.389352 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:36.392781 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:36.394267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:36.395269 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:36.438069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:36.453302 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:36.455167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:36.456482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-11975d2f-7c71-4414-ae6a-b390017130d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.662624 Aug 31 00:19:36.457652 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 42/83] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:35 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:36.541013 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-7c322c61-10b1-4f1d-9c6c-db9d6e6f53ee req-d7b36b4a-f7f5-41ab-b084-69d5310ae7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28862807-4ab6-4376-9e01-b40cd4e4483a", "tag": "07e1f3ff-ed06-4bbc-af49-616e3dd80848"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:36.557617 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-7c322c61-10b1-4f1d-9c6c-db9d6e6f53ee req-d7b36b4a-f7f5-41ab-b084-69d5310ae7d1 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:36.558355 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-7c322c61-10b1-4f1d-9c6c-db9d6e6f53ee req-d7b36b4a-f7f5-41ab-b084-69d5310ae7d1 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:36.559016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-7c322c61-10b1-4f1d-9c6c-db9d6e6f53ee req-d7b36b4a-f7f5-41ab-b084-69d5310ae7d1 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:36.577044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-7c322c61-10b1-4f1d-9c6c-db9d6e6f53ee req-d7b36b4a-f7f5-41ab-b084-69d5310ae7d1 service nova] Creating event network-changed:07e1f3ff-ed06-4bbc-af49-616e3dd80848 for instance 28862807-4ab6-4376-9e01-b40cd4e4483a on hv-cinder-85220 Aug 31 00:19:36.591214 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-7c322c61-10b1-4f1d-9c6c-db9d6e6f53ee req-d7b36b4a-f7f5-41ab-b084-69d5310ae7d1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124254 Aug 31 00:19:36.592894 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 43/84] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:36.601790 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:36.603007 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:36.633721 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:36.634255 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:36.634697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:36.642494 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:36.643098 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:36.643541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:36.927429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:36.935121 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-153d66e3-ef10-4553-811c-40acff5d4821 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.570656 Aug 31 00:19:36.938536 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 42/85] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:36 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:37.044977 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:37.046465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:37.053792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:37.054511 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:37.055255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:37.056556 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:37.057155 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:37.057723 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:37.138488 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:37.163891 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-288ad38d-3689-48f2-ae43-2626b57574d7 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.566099 Aug 31 00:19:37.165654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 44/86] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:36 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:37.488547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:37.490000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:37.500421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:37.501451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:37.505738 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:37.507672 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:37.508418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:37.510552 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:37.652170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:37.660454 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-07118fbd-f434-42bd-91cf-ac3f5787c612 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.619208 Aug 31 00:19:37.664241 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 43/87] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:37 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:37.959379 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:37.960715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:37.968882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:37.969657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:37.970892 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:37.972133 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:37.972820 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:37.974064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:38.089799 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:38.105068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:38.112843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:38.118067 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5d8242f4-b659-4411-b2b7-52e6c4c0ee2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.634693 Aug 31 00:19:38.134462 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 45/88] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:37 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:38.186036 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:38.186846 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:38.197251 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:38.197739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:38.198363 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:38.199305 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:38.199962 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:38.200592 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:38.221861 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:38.255797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-61eebe60-c6f9-4b5d-8536-8415f4cc4886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.298860 Aug 31 00:19:38.259461 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 44/89] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:37 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:38.577720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:38.586564 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-35a9062a-255f-443d-b908-3dce887f1e3e tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.404421 Aug 31 00:19:38.600167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 46/90] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:38 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:38.650403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-d92a6113-14b4-48d9-b32b-cfa30625008c req-352f372c-fd90-49ae-9c40-7c374518ee60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0ed52f-01dd-4013-8576-086e53d0afc8", "tag": "0858dfb7-8ad6-4e1f-807c-223b65e2a9b0"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:38.684855 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:38.685474 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:38.709218 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:38.710140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:38.712464 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:38.713516 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:38.714092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-d92a6113-14b4-48d9-b32b-cfa30625008c req-352f372c-fd90-49ae-9c40-7c374518ee60 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:38.714366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:38.714598 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-d92a6113-14b4-48d9-b32b-cfa30625008c req-352f372c-fd90-49ae-9c40-7c374518ee60 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:38.714921 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:38.715030 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-d92a6113-14b4-48d9-b32b-cfa30625008c req-352f372c-fd90-49ae-9c40-7c374518ee60 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:38.782506 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-d92a6113-14b4-48d9-b32b-cfa30625008c req-352f372c-fd90-49ae-9c40-7c374518ee60 service nova] Creating event network-changed:0858dfb7-8ad6-4e1f-807c-223b65e2a9b0 for instance 0a0ed52f-01dd-4013-8576-086e53d0afc8 on hv-cinder-85220 Aug 31 00:19:38.783716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-d92a6113-14b4-48d9-b32b-cfa30625008c req-352f372c-fd90-49ae-9c40-7c374518ee60 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132201) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 00:19:38.784115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-d92a6113-14b4-48d9-b32b-cfa30625008c req-352f372c-fd90-49ae-9c40-7c374518ee60 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132201) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 00:19:38.787355 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ae7cd16-b7de-4cd2-9b65-e55e206ae128 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:38.787822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ae7cd16-b7de-4cd2-9b65-e55e206ae128 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:38.788281 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ae7cd16-b7de-4cd2-9b65-e55e206ae128 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:38.789054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ae7cd16-b7de-4cd2-9b65-e55e206ae128 None None] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:38.793769 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ae7cd16-b7de-4cd2-9b65-e55e206ae128 None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:38.794321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ae7cd16-b7de-4cd2-9b65-e55e206ae128 None None] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:38.823811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.compute.rpcapi [None req-9ae7cd16-b7de-4cd2-9b65-e55e206ae128 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 00:19:38.830272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ae7cd16-b7de-4cd2-9b65-e55e206ae128 None None] Releasing lock "compute-rpcapi-router" {{(pid=132201) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 00:19:38.882518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9ae7cd16-b7de-4cd2-9b65-e55e206ae128 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249931 Aug 31 00:19:38.884005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 45/91] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:38.890250 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-cd2a1d32-edf6-4d68-8541-6f8c13151c41 req-abf1d61e-334f-491d-9c08-d093ebb6158d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79afdc5d-5e48-40a0-a1f4-624fddd73fee", "tag": "00b6ea8b-b25e-4fd9-bfcc-0ed942d7b29b"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:38.906721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-cd2a1d32-edf6-4d68-8541-6f8c13151c41 req-abf1d61e-334f-491d-9c08-d093ebb6158d service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:38.908128 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-cd2a1d32-edf6-4d68-8541-6f8c13151c41 req-abf1d61e-334f-491d-9c08-d093ebb6158d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:38.908716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-cd2a1d32-edf6-4d68-8541-6f8c13151c41 req-abf1d61e-334f-491d-9c08-d093ebb6158d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:38.921879 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-cd2a1d32-edf6-4d68-8541-6f8c13151c41 req-abf1d61e-334f-491d-9c08-d093ebb6158d service nova] Creating event network-changed:00b6ea8b-b25e-4fd9-bfcc-0ed942d7b29b for instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee on hv-cinder-85220 Aug 31 00:19:38.929824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-cd2a1d32-edf6-4d68-8541-6f8c13151c41 req-abf1d61e-334f-491d-9c08-d093ebb6158d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044160 Aug 31 00:19:38.930735 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 46/92] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:39.297187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:39.312633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c69b8495-8005-41f1-93e1-f1ceb979768e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.629548 Aug 31 00:19:39.313940 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 47/93] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:38 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:39.329114 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:39.330613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:39.351021 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:39.351694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:39.352138 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:39.354242 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:39.357551 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:39.358909 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:39.394294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-63eb5ad1-b752-444e-8cf9-c381d910be91 req-8319d536-7b34-4245-951d-9d9ea26c232a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b85b900-da07-4c75-b7f3-4d0681c11d3a", "name": "network-vif-plugged", "status": "completed", "tag": "91d0ea44-40c9-4a3e-b2ec-4b47827fa644"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:39.408234 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-63eb5ad1-b752-444e-8cf9-c381d910be91 req-8319d536-7b34-4245-951d-9d9ea26c232a service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:39.409047 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-63eb5ad1-b752-444e-8cf9-c381d910be91 req-8319d536-7b34-4245-951d-9d9ea26c232a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:39.409705 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-63eb5ad1-b752-444e-8cf9-c381d910be91 req-8319d536-7b34-4245-951d-9d9ea26c232a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:39.422093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-63eb5ad1-b752-444e-8cf9-c381d910be91 req-8319d536-7b34-4245-951d-9d9ea26c232a service nova] Creating event network-vif-plugged:91d0ea44-40c9-4a3e-b2ec-4b47827fa644 for instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a on hv-cinder-85220 Aug 31 00:19:39.434818 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-63eb5ad1-b752-444e-8cf9-c381d910be91 req-8319d536-7b34-4245-951d-9d9ea26c232a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.468310 Aug 31 00:19:39.440007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 47/94] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:39.447483 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:39.448440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:39.463859 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:39.464361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:39.464961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:39.466637 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:39.467113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:39.467544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:39.768543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:39.778102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f04dcc1f-2743-4b02-8f06-75fb69cfcbd4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.336786 Aug 31 00:19:39.785013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 48/95] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:39 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:39.797836 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:39.798961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:39.809754 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:39.822626 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:39.823332 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:39.824243 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:39.824709 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:39.825141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:40.292792 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:40.309927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:40.311825 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:40.314898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9d43b791-51b0-464a-9528-8140bd222dab tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.997804 Aug 31 00:19:40.316366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 48/96] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:39 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:40.329730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:40.336689 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:40.337652 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:40.342287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c1fd88f3-6f8e-4580-a179-79eca463f255 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.554504 Aug 31 00:19:40.342882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 49/97] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:39 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:40.360016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:40.360800 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:40.362058 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:40.363448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:40.364285 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:40.365134 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:40.776073 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:40.789057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fe81ce6e-56e7-41c9-9544-d10200567303 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.453050 Aug 31 00:19:40.789679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 49/98] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:40 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:40.806181 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:40.806798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:40.817532 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:40.819972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:40.822467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:40.823559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:40.824305 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:40.827307 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:40.920137 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-01a2ad34-3fac-4d9a-93a7-811702b5a4e1 req-9f9a5ebd-fb04-4b09-ae46-3072061574ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd82cf1-9e95-469a-ae36-ffca42f83f3a", "tag": "76733a2a-08f7-4f06-b114-63f2a8fc3f2a"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:40.954085 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-01a2ad34-3fac-4d9a-93a7-811702b5a4e1 req-9f9a5ebd-fb04-4b09-ae46-3072061574ad service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:40.954888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-01a2ad34-3fac-4d9a-93a7-811702b5a4e1 req-9f9a5ebd-fb04-4b09-ae46-3072061574ad service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:40.955572 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-01a2ad34-3fac-4d9a-93a7-811702b5a4e1 req-9f9a5ebd-fb04-4b09-ae46-3072061574ad service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:40.970592 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-01a2ad34-3fac-4d9a-93a7-811702b5a4e1 req-9f9a5ebd-fb04-4b09-ae46-3072061574ad service nova] Creating event network-changed:76733a2a-08f7-4f06-b114-63f2a8fc3f2a for instance acd82cf1-9e95-469a-ae36-ffca42f83f3a on hv-cinder-85220 Aug 31 00:19:40.977110 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-01a2ad34-3fac-4d9a-93a7-811702b5a4e1 req-9f9a5ebd-fb04-4b09-ae46-3072061574ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071182 Aug 31 00:19:40.978571 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 50/99] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:41.121671 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:41.135388 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-be5bfcc8-cad6-479f-847e-e7764e7d16b8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.333832 Aug 31 00:19:41.136399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 50/100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:40 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:41.342562 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:41.343260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:41.349700 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:41.350358 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:41.351349 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:41.352495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:41.352495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:41.352916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:41.362654 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:41.363268 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:41.370410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:41.370890 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:41.371932 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:41.372612 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:41.373063 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:41.373483 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:41.555290 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:41.564048 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3a40f69f-36dd-4ccd-ac1e-feaf1c7e721b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.205410 Aug 31 00:19:41.565060 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 51/101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:41 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:41.567771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:41.576877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:41.579206 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:41.580669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3086eca1-12d6-416e-8fc7-829446963518 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.242292 Aug 31 00:19:41.581286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 51/102] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:41 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:41.812273 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:41.812880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:41.818877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:41.819355 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:41.820120 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:41.820809 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:41.821254 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:41.821666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:42.017309 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:42.026225 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2d5138cd-c43c-44a4-9e54-d3ba7d8700e8 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.217909 Aug 31 00:19:42.027126 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 52/103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:41 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:42.159465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:42.161460 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:42.175850 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:42.177083 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:42.177775 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:42.178708 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:42.179207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:42.181077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:42.399449 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:42.410457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5c00ae51-3029-4d53-9c15-5c88fafd6eb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.257177 Aug 31 00:19:42.411908 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 52/104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:42 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:42.587579 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:42.588822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-bec81668-4d3c-480f-9fbd-76e0d5863def req-2abd6ab5-12da-468c-a456-6c513c112c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28862807-4ab6-4376-9e01-b40cd4e4483a", "name": "network-vif-plugged", "status": "completed", "tag": "07e1f3ff-ed06-4bbc-af49-616e3dd80848"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:42.591160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:42.606226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:42.607016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:42.607857 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:42.618160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:42.618790 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:42.620093 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:42.622290 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-bec81668-4d3c-480f-9fbd-76e0d5863def req-2abd6ab5-12da-468c-a456-6c513c112c85 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:42.625238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-bec81668-4d3c-480f-9fbd-76e0d5863def req-2abd6ab5-12da-468c-a456-6c513c112c85 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:42.626323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-bec81668-4d3c-480f-9fbd-76e0d5863def req-2abd6ab5-12da-468c-a456-6c513c112c85 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:42.667777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-bec81668-4d3c-480f-9fbd-76e0d5863def req-2abd6ab5-12da-468c-a456-6c513c112c85 service nova] Creating event network-vif-plugged:07e1f3ff-ed06-4bbc-af49-616e3dd80848 for instance 28862807-4ab6-4376-9e01-b40cd4e4483a on hv-cinder-85220 Aug 31 00:19:42.680404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-bec81668-4d3c-480f-9fbd-76e0d5863def req-2abd6ab5-12da-468c-a456-6c513c112c85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104649 Aug 31 00:19:42.685549 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 53/105] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:42.703303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:42.704237 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:42.718483 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:42.719000 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:42.721732 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:42.725133 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:42.726141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:42.726584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:42.813501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:42.826252 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-60ff81e4-e770-4c8f-b2f8-dedfce262477 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.245026 Aug 31 00:19:42.827032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 53/106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:42 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:42.917389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:42.927069 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:42.929400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:42.930712 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-352a1f92-c579-4789-9e26-a330d7759393 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.240522 Aug 31 00:19:42.931303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 54/107] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:42 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:43.049697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:43.050538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:43.063519 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:43.064221 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:43.066211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:43.067695 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:43.070089 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:43.071771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:43.264337 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:43.297087 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:43.305307 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-994f2611-6c24-48d5-b8c3-5787e6b0a722 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.261292 Aug 31 00:19:43.305924 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 54/108] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:43 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:43.432691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:43.433415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:43.439780 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:43.440475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:43.440909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:43.441596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:43.442101 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:43.442565 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:43.676551 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:43.704001 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cb405bc2-4b7c-4fa4-a280-964159e7f670 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.275486 Aug 31 00:19:43.704947 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 55/109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:43 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:43.848340 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:43.849111 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:43.874790 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:43.875478 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:43.876064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:43.877097 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:43.877701 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:43.878655 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:43.904067 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:43.954604 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:43.955366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:43.961934 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:43.962562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:43.963459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:43.964372 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:43.964897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:43.965537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:44.060232 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:44.068373 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-87a4e0e5-b2b1-414b-a6fd-614d2ba2b901 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.223984 Aug 31 00:19:44.068953 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 55/110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:43 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:44.107605 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:44.116235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:44.117667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:44.118785 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-334be257-0fcf-4983-b055-cdf537efd234 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.168586 Aug 31 00:19:44.119343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 56/111] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:43 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:44.328414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:44.329834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:44.336314 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:44.337199 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:44.338296 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:44.339204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:44.339885 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:44.340749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:44.508201 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:44.516177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6ba2824b-81a2-44af-80b9-267e79e1c720 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.191947 Aug 31 00:19:44.516753 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 56/112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:44 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:44.727540 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:44.728151 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:44.734087 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:44.734571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:44.735003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:44.735745 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:44.736125 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:44.736545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:44.869373 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:44.877776 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5233815d-16dc-438d-87e4-1104ca6e681a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.153805 Aug 31 00:19:44.878161 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 57/113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:44 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:45.088893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:45.089534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:45.095452 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:45.095940 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:45.096364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:45.097049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:45.097492 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:45.097926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:45.141619 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:45.142556 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:45.148701 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:45.149276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:45.149982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:45.150689 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:45.151303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:45.151924 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:45.237321 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:45.246187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8bb8174a-8924-45f2-a97c-711a0341c9d9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.160971 Aug 31 00:19:45.247077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 57/114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:45 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:45.287064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:45.295410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:45.297090 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:45.298252 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-58fd0e58-368e-425d-9876-c180696b0ca0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.160741 Aug 31 00:19:45.299071 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 58/115] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:45 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:45.536742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:45.537505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:45.546965 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:45.547670 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:45.548163 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:45.549224 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:45.549794 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:45.550253 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:45.678832 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:45.687277 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cac4c07b-d793-4846-b197-6ef42bea54f5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.154756 Aug 31 00:19:45.687837 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 58/116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:45 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:45.899134 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:45.899846 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:45.905792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:45.906303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:45.906741 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:45.907427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:45.907878 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:45.908302 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:46.112022 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:46.120916 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-71c6f7e8-f3aa-43b4-9785-fd9f9292f7c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.225789 Aug 31 00:19:46.121499 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 59/117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:45 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:46.268586 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:46.269292 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:46.275432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:46.275989 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:46.276484 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:46.277236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:46.277753 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:46.278266 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:46.320972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:46.321977 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:46.328916 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:46.329414 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:46.329871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:46.330698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:46.331280 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:46.331899 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:46.353020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:46.430327 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:46.441674 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0794559d-4381-4ca4-9091-a89458150922 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.176750 Aug 31 00:19:46.443297 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 59/118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:46 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:46.486410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:46.495513 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:46.496994 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:46.498135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-18dbd40a-8d52-43a0-a65d-35732933f533 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.180964 Aug 31 00:19:46.498687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 60/119] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:46 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:46.709440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:46.710352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:46.716775 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:46.717442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:46.718129 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:46.719258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:46.720075 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:46.720655 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:46.774129 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-63abae09-4f53-4fc0-bc8c-d7b686f7b66f req-82d1adcb-8163-4f1f-86bd-f023cc57cd0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd82cf1-9e95-469a-ae36-ffca42f83f3a", "name": "network-vif-plugged", "status": "completed", "tag": "76733a2a-08f7-4f06-b114-63f2a8fc3f2a"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:46.785128 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-63abae09-4f53-4fc0-bc8c-d7b686f7b66f req-82d1adcb-8163-4f1f-86bd-f023cc57cd0a service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:46.786477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-63abae09-4f53-4fc0-bc8c-d7b686f7b66f req-82d1adcb-8163-4f1f-86bd-f023cc57cd0a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:46.787312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-63abae09-4f53-4fc0-bc8c-d7b686f7b66f req-82d1adcb-8163-4f1f-86bd-f023cc57cd0a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:46.799788 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-63abae09-4f53-4fc0-bc8c-d7b686f7b66f req-82d1adcb-8163-4f1f-86bd-f023cc57cd0a service nova] Creating event network-vif-plugged:76733a2a-08f7-4f06-b114-63f2a8fc3f2a for instance acd82cf1-9e95-469a-ae36-ffca42f83f3a on hv-cinder-85220 Aug 31 00:19:46.809805 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-63abae09-4f53-4fc0-bc8c-d7b686f7b66f req-82d1adcb-8163-4f1f-86bd-f023cc57cd0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039662 Aug 31 00:19:46.810708 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 61/120] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:19:46.885332 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:46.894753 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-90d14da8-bb87-4fde-b6ee-44b61a01604c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.189968 Aug 31 00:19:46.907314 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 60/121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:46 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:47.141608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:47.142389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:47.149148 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:47.149631 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:47.150091 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:47.150776 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:47.151227 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:47.151643 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:47.282019 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:47.289802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e4b50085-48f8-4ce6-a0f6-feda78c80e69 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.152508 Aug 31 00:19:47.290428 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 62/122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:47 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:47.462804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:47.463426 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:47.469215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:47.469688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:47.470150 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:47.470819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:47.471300 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:47.471839 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:47.524565 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:47.525182 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:47.531068 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:47.531553 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:47.532182 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:47.532877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:47.533526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:47.534144 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:47.615282 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:47.623026 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e8d7b489-31cf-4d89-9789-1b45c2e04ae8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.163996 Aug 31 00:19:47.623773 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 61/123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:47 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:47.669276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:47.679822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:47.681434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:47.682704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5f171547-63c4-410b-9f42-3b28207be8b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.161948 Aug 31 00:19:47.683313 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 63/124] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:47 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:47.915992 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:47.916534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:47.922421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:47.922902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:47.923588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:47.924273 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:47.924721 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:47.925141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.056990 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:48.064770 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e4340c61-5c45-41cd-90f4-c1a6a4b263a6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.152782 Aug 31 00:19:48.065331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 62/125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:47 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:48.310706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:48.311342 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:48.317333 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.317812 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.318283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.318973 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.319430 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.319854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.446513 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:48.454891 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c7d2e3fb-5864-423f-88d5-cb278f21c098 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.148068 Aug 31 00:19:48.455448 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 64/126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:48 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:48.643799 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:48.644406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:48.650929 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.651410 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.651842 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.652525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.652980 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.653406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.705529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:48.706204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:48.713145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.713700 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.714290 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.714999 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:48.715451 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:48.715867 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:48.783881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:48.791727 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cd28c30c-556b-4ed9-9b65-0aeab76a2d81 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.151725 Aug 31 00:19:48.792483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 63/127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:48 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:48.818009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:48.848222 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:48.856381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:48.857839 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:48.858964 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-dc142932-e6e5-4322-a655-228cfed4d9bb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.157477 Aug 31 00:19:48.859518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 65/128] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:48 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:49.085436 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:49.086136 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:49.092085 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:49.092559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:49.092986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:49.093666 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:49.094160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:49.094581 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:49.225069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:49.232711 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b1c86fe6-91f6-4f35-83fa-94f74dfae752 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.151160 Aug 31 00:19:49.233270 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 64/129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:49 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:49.476271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:49.476873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:49.493230 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:49.493975 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:49.494426 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:49.495144 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:49.495600 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:49.496030 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:49.645366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:49.653111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9958518f-1479-410c-a096-8e6f450af590 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.181406 Aug 31 00:19:49.653666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 66/130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:49 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:49.813607 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:49.814865 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:49.826126 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:49.826604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:49.827052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:49.827846 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:49.828347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:49.828820 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:49.881629 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:49.882237 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:49.888377 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:49.889111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:49.889546 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:49.890277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:49.890995 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:49.891509 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:50.031478 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:50.039916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d54ce1ba-6d84-45d3-acde-81b67521b137 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.230925 Aug 31 00:19:50.040522 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 65/131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:49 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:50.063095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:50.071929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:50.073508 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:50.074807 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4236b40c-66d4-4cff-837f-47ef2474a880 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.197563 Aug 31 00:19:50.075444 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 67/132] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:49 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:50.254657 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:50.255280 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:50.261171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:50.261653 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:50.262133 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:50.262814 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:50.263265 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:50.263691 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:50.393273 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:50.400949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b8c54ff5-a527-4931-b871-89687ec9b5ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.150576 Aug 31 00:19:50.401502 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 66/133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:50 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:50.675021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:50.675859 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:50.682396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:50.682880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:50.683312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:50.683991 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:50.684439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:50.684874 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:50.827549 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:50.835350 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-dd25c028-2f65-42ac-9e21-587a470aef1b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.164455 Aug 31 00:19:50.836253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 68/134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:50 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:51.063945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:51.064791 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:51.070733 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:51.071208 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:51.071818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:51.072502 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:51.072947 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:51.073364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:51.099374 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:51.099993 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:51.109631 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:51.110228 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:51.110672 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:51.111380 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:51.111843 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:51.112257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:51.216325 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:51.225080 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d135dd39-75d8-4cb4-b6f9-928fa9951789 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.168353 Aug 31 00:19:51.238259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 67/135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:51 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:51.269212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:51.277786 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:51.279270 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:51.280407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e6726fea-6f0e-43c5-8093-1a53dab28556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.186244 Aug 31 00:19:51.281113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 69/136] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:51 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:51.421822 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:51.422487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:51.428713 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:51.429192 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:51.429626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:51.430344 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:51.430796 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:51.431223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:51.559423 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:51.567532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-91f5e785-fff3-46f0-b24b-fad58969f0ea tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.149608 Aug 31 00:19:51.568128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 68/137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:51 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:51.856480 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:51.857003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:51.863111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:51.864108 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:51.864543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:51.865227 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:51.865679 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:51.866129 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:51.991084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:51.998673 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-30917f10-bd21-4f29-ae7f-2b03d64d1a33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.146151 Aug 31 00:19:51.999242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 70/138] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:51 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:52.245781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:52.246414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:52.252248 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:52.252726 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:52.253156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:52.253837 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:52.254387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:52.254806 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:52.303425 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:52.304032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:52.307010 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:52.310330 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:52.310812 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:52.311245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:52.311966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:52.312417 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:52.312836 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:52.391077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:52.398681 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bda2aea3-fefb-4147-aaac-f7e25fcd7b20 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.156777 Aug 31 00:19:52.399253 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 69/139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:52 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:52.448989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:52.458146 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:52.459589 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:52.460687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4e130309-709d-42c9-8da4-c88f95496cc0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.162107 Aug 31 00:19:52.461244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 71/140] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:52 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:52.588224 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:52.588846 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:52.594750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:52.595234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:52.595672 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:52.596352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:52.596804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:52.597226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:52.723552 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:52.731349 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cff6b122-9073-4b38-b483-282d5a0689e2 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.147013 Aug 31 00:19:52.731902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 70/141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:52 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:53.021428 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:53.022131 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:53.028443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:53.028977 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:53.029387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:53.030116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:53.030581 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:53.031002 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:53.179841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:53.187941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1190ee20-0568-48b0-805a-aacd7a8db1c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.171217 Aug 31 00:19:53.188526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 72/142] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:53 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:53.419964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:53.421310 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:53.429062 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:53.429886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:53.430508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:53.431534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:53.432057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:53.432550 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:53.487710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:53.489505 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:53.496673 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:53.497258 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:53.497755 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:53.498803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:53.499342 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:53.499783 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:53.648872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:53.663922 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f46ed26b-2a56-4016-ba24-2a4a6796c349 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.247690 Aug 31 00:19:53.670502 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 71/143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:53 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:53.759700 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:53.760312 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:53.781603 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:53.787065 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:53.787849 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:53.788802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:53.789065 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:53.789723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:53.790365 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:53.798997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:53.800013 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:53.801938 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:53.803489 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4adecdac-16ea-4cee-96da-fd3c018670af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1406 microversion: 2.20 time: 0.323909 Aug 31 00:19:53.819855 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 73/144] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:53 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:19:53.969664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:53.978310 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-add0aa80-43c7-4f2a-bedd-013270e5f4cb tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.229751 Aug 31 00:19:53.979152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 72/145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:53 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:19:54.209115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:54.209839 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:54.215856 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:54.216362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:54.216824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:54.217507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:54.217986 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:54.218404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:54.407925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:54.416917 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-85777a6f-b7ab-4d9c-bb9a-5ffa6b8903e2 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.212270 Aug 31 00:19:54.417493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 74/146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:54 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:54.693231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:54.694450 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:54.700546 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:54.701049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:54.702260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:54.703114 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:54.703765 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:54.704196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:54.830526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:54.831458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:54.855151 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:54.858898 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:54.859429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:54.860245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:54.867664 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:54.869144 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:54.985066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:54.994777 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-20205c70-6c6e-4599-b6de-4e00ebad7041 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.306038 Aug 31 00:19:55.004686 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 73/147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:54 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:55.010341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-1a2da150-ce08-4179-94bd-fc0d4d1823ea req-8d6e2729-f9c2-4546-98a8-ca9b1e1f6336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0ed52f-01dd-4013-8576-086e53d0afc8", "name": "network-vif-plugged", "status": "completed", "tag": "0858dfb7-8ad6-4e1f-807c-223b65e2a9b0"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:55.027215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-1a2da150-ce08-4179-94bd-fc0d4d1823ea req-8d6e2729-f9c2-4546-98a8-ca9b1e1f6336 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:55.028336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-1a2da150-ce08-4179-94bd-fc0d4d1823ea req-8d6e2729-f9c2-4546-98a8-ca9b1e1f6336 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:55.029018 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-1a2da150-ce08-4179-94bd-fc0d4d1823ea req-8d6e2729-f9c2-4546-98a8-ca9b1e1f6336 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:55.064135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-1a2da150-ce08-4179-94bd-fc0d4d1823ea req-8d6e2729-f9c2-4546-98a8-ca9b1e1f6336 service nova] Creating event network-vif-plugged:0858dfb7-8ad6-4e1f-807c-223b65e2a9b0 for instance 0a0ed52f-01dd-4013-8576-086e53d0afc8 on hv-cinder-85220 Aug 31 00:19:55.070624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-1a2da150-ce08-4179-94bd-fc0d4d1823ea req-8d6e2729-f9c2-4546-98a8-ca9b1e1f6336 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064497 Aug 31 00:19:55.071539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 74/148] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:55.077650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:55.078671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:55.088421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:55.089206 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:55.089927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:55.090684 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:55.091057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:55.091482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:55.139050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:55.158244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:55.161135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:55.163871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-982f1c30-4c58-491a-809d-c3f5c2eb4f09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1598 microversion: 2.20 time: 0.338895 Aug 31 00:19:55.164682 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 75/149] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:19:54 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1598 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:19:55.189501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bf29aad3-d0f2-45e4-8d56-d5010046d649 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:55.190931 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bf29aad3-d0f2-45e4-8d56-d5010046d649 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:55.208235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf29aad3-d0f2-45e4-8d56-d5010046d649 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:55.209154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf29aad3-d0f2-45e4-8d56-d5010046d649 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:55.211845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf29aad3-d0f2-45e4-8d56-d5010046d649 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:55.213475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf29aad3-d0f2-45e4-8d56-d5010046d649 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:55.215498 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf29aad3-d0f2-45e4-8d56-d5010046d649 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:55.219131 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf29aad3-d0f2-45e4-8d56-d5010046d649 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:55.305388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:55.316260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c6df6fd8-1a71-4689-8b19-84dc09961844 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1363 microversion: 2.1 time: 0.242872 Aug 31 00:19:55.317561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 75/150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:55 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:55.438851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:55.440583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:55.455622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bf29aad3-d0f2-45e4-8d56-d5010046d649 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.269706 Aug 31 00:19:55.462721 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:55.464909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 76/151] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 31 00:19:55 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-interface => generated 285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:19:55.469329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:55.469886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:55.470683 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:55.471142 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:55.478992 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:55.831710 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:55.839618 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6f14dabb-a16d-4cc7-8a9a-2876173c04a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.405642 Aug 31 00:19:55.840235 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 76/152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:55 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:56.025191 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:56.026050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:56.038308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:56.039370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:56.040119 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:56.047986 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:56.049207 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:56.049857 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:56.230785 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:56.252101 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5e4f158a-5ca7-4134-bbeb-1d7369471b33 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.231397 Aug 31 00:19:56.257137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 77/153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:56 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:56.340367 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:56.341166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:56.345204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:56.354427 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:56.354919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:56.355362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:56.356070 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:56.356522 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:56.356948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:56.872220 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:56.876424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:56.877368 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:56.884162 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-24821451-b82d-4531-8049-b8ea8cf8d690 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1548 microversion: 2.1 time: 0.550026 Aug 31 00:19:56.887620 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:56.888401 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:56.889069 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:56.889220 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 77/154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:56 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1548 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:56.890321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:56.891013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:56.891746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:56.911971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:56.924168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9f8ef433-4f0f-48f2-b5df-150e31ce3ffe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:56.924666 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9f8ef433-4f0f-48f2-b5df-150e31ce3ffe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:56.937593 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9f8ef433-4f0f-48f2-b5df-150e31ce3ffe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:56.938154 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9f8ef433-4f0f-48f2-b5df-150e31ce3ffe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:56.938598 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9f8ef433-4f0f-48f2-b5df-150e31ce3ffe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:56.939409 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9f8ef433-4f0f-48f2-b5df-150e31ce3ffe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:56.939873 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9f8ef433-4f0f-48f2-b5df-150e31ce3ffe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:56.943046 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9f8ef433-4f0f-48f2-b5df-150e31ce3ffe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:57.140842 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:57.155672 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3591c57f-e5e2-480d-b51d-412c8003ba0f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.290931 Aug 31 00:19:57.170363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 78/155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:56 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:57.175608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-a455ea82-1e3a-4ff8-8d7b-5b314da554c6 req-148a660e-94dd-4aa1-8c1a-7e162574b976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79afdc5d-5e48-40a0-a1f4-624fddd73fee", "name": "network-vif-plugged", "status": "completed", "tag": "00b6ea8b-b25e-4fd9-bfcc-0ed942d7b29b"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:57.187299 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-a455ea82-1e3a-4ff8-8d7b-5b314da554c6 req-148a660e-94dd-4aa1-8c1a-7e162574b976 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:57.187954 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-a455ea82-1e3a-4ff8-8d7b-5b314da554c6 req-148a660e-94dd-4aa1-8c1a-7e162574b976 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:57.188542 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-a455ea82-1e3a-4ff8-8d7b-5b314da554c6 req-148a660e-94dd-4aa1-8c1a-7e162574b976 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:57.211157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-a455ea82-1e3a-4ff8-8d7b-5b314da554c6 req-148a660e-94dd-4aa1-8c1a-7e162574b976 service nova] Creating event network-vif-plugged:00b6ea8b-b25e-4fd9-bfcc-0ed942d7b29b for instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee on hv-cinder-85220 Aug 31 00:19:57.216800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-a455ea82-1e3a-4ff8-8d7b-5b314da554c6 req-148a660e-94dd-4aa1-8c1a-7e162574b976 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044983 Aug 31 00:19:57.217715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 79/156] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:57.238101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9f8ef433-4f0f-48f2-b5df-150e31ce3ffe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.320862 Aug 31 00:19:57.247054 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 78/157] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 31 00:19:56 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/os-interface => generated 284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:57.280986 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:57.281882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:57.306307 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:57.309768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:57.313114 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:57.314050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:57.314877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:57.315233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:57.609867 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-85acdd10-99f5-487c-a8a1-e1b8676beee7 req-bde98ad6-d6e2-4a79-b36b-277175dfa453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28862807-4ab6-4376-9e01-b40cd4e4483a", "tag": "07e1f3ff-ed06-4bbc-af49-616e3dd80848"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:57.620912 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-85acdd10-99f5-487c-a8a1-e1b8676beee7 req-bde98ad6-d6e2-4a79-b36b-277175dfa453 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:57.629997 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-85acdd10-99f5-487c-a8a1-e1b8676beee7 req-bde98ad6-d6e2-4a79-b36b-277175dfa453 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:57.630641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-85acdd10-99f5-487c-a8a1-e1b8676beee7 req-bde98ad6-d6e2-4a79-b36b-277175dfa453 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:57.648552 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-85acdd10-99f5-487c-a8a1-e1b8676beee7 req-bde98ad6-d6e2-4a79-b36b-277175dfa453 service nova] Creating event network-changed:07e1f3ff-ed06-4bbc-af49-616e3dd80848 for instance 28862807-4ab6-4376-9e01-b40cd4e4483a on hv-cinder-85220 Aug 31 00:19:57.654545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-85acdd10-99f5-487c-a8a1-e1b8676beee7 req-bde98ad6-d6e2-4a79-b36b-277175dfa453 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048981 Aug 31 00:19:57.655339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 79/158] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:19:57.746343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:57.755403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-32c2c8d7-c8ea-41f0-8e71-8a3a6c3d0df8 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.479592 Aug 31 00:19:57.759779 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 80/159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:57 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:58.178003 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:58.178710 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:58.192575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:58.193266 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:58.194050 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:58.194950 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:58.196167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:58.198198 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:58.389675 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:58.403317 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a38c063b-85db-4c7b-861e-b9188231f64f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1322 microversion: 2.1 time: 0.230376 Aug 31 00:19:58.423028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 80/160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:58 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:58.805367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:58.806165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:58.818793 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:58.822672 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:58.824287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:58.827123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:58.827965 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:58.830669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:59.250719 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:59.261313 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b99d357c-6112-420a-a888-e1a4ca02f6c9 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.472894 Aug 31 00:19:59.264957 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 81/161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:58 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:59.424887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:19:59.428095 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:59.437583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:59.443652 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:59.444221 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:59.445009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:59.445538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:59.446118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:59.517147 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-131de01c-532c-43ae-a986-8a49d2af71dd req-dc11bb07-eb7c-48b9-bae9-2766f4adfeff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd82cf1-9e95-469a-ae36-ffca42f83f3a", "tag": "76733a2a-08f7-4f06-b114-63f2a8fc3f2a"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:59.530514 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-131de01c-532c-43ae-a986-8a49d2af71dd req-dc11bb07-eb7c-48b9-bae9-2766f4adfeff service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:59.532510 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-131de01c-532c-43ae-a986-8a49d2af71dd req-dc11bb07-eb7c-48b9-bae9-2766f4adfeff service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:59.533675 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-131de01c-532c-43ae-a986-8a49d2af71dd req-dc11bb07-eb7c-48b9-bae9-2766f4adfeff service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:59.564369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-131de01c-532c-43ae-a986-8a49d2af71dd req-dc11bb07-eb7c-48b9-bae9-2766f4adfeff service nova] Creating event network-changed:76733a2a-08f7-4f06-b114-63f2a8fc3f2a for instance acd82cf1-9e95-469a-ae36-ffca42f83f3a on hv-cinder-85220 Aug 31 00:19:59.599381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-131de01c-532c-43ae-a986-8a49d2af71dd req-dc11bb07-eb7c-48b9-bae9-2766f4adfeff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087353 Aug 31 00:19:59.608780 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 82/162] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:19:59.841568 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:19:59.849897 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7a5a193a-6f54-4fb1-89a5-eb816afdb86d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1516 microversion: 2.1 time: 0.429240 Aug 31 00:19:59.850654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 81/163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:19:59 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1516 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:19:59.872846 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:19:59.875629 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:19:59.882479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:59.883137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:59.883575 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:59.884403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:19:59.884985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:19:59.885412 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:19:59.916862 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lazy-loading 'flavor' on Instance uuid 0a0ed52f-01dd-4013-8576-086e53d0afc8 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:20:00.055547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-da914606-9793-4997-992c-a0330eba4ace tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8/action" status: 200 len: 32 microversion: 2.1 time: 0.187943 Aug 31 00:20:00.056150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 83/164] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:19:59 2022] POST /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 00:20:00.069016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:00.070149 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:00.080985 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:00.084616 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:00.085199 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:00.086061 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:00.087981 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:00.088549 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:00.288104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:00.288806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:00.304994 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:00.305249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:00.305688 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:00.315748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:00.316274 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:00.316721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:00.388314 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:00.399927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-462d6e8b-1180-43ac-a573-4e311f423a1e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.337905 Aug 31 00:20:00.416133 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 82/165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:00 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:00.583165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:00.600442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a9871310-00e2-41e0-be7c-000da102be91 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1315 microversion: 2.1 time: 0.316738 Aug 31 00:20:00.602523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 84/166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:00 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:01.399456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-272958958", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:01.429360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:01.430007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:01.436598 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:01.437088 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:01.437521 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:01.438600 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:01.439059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:01.439486 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:01.464446 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.network.neutron [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] validate_networks() for None {{(pid=132200) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:01.573979 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:01.583121 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5f33f7e3-1005-4b55-9623-57e3d66b6a54 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.158427 Aug 31 00:20:01.583694 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 85/167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:01 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:01.623722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:01.624591 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:01.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:01.632135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:01.632567 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:01.633318 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:01.633795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:01.634410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:01.744127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Flavor limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:01.744127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Image limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:01.744753 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Flavor pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:01.745169 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Image pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:01.745939 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:01.757121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:01.757606 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:01.758078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:01.758804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:01.759258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:01.759679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:01.764344 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:01.771997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ad04dd1e-2bda-4d9e-8db4-b75871c155dc tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1501 microversion: 2.1 time: 0.152278 Aug 31 00:20:01.772558 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 86/168] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:01 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:01.776748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Getting quotas for project 9f15ffcbae924b52830ebc980091bf40. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:01.780830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Getting quotas for user efd87db4f6344050b39048acdd3cdd56 and project 9f15ffcbae924b52830ebc980091bf40. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:01.792234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Going to run 1 instances... {{(pid=132200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:01.794578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:01.844333 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e455b24b-e4a3-442b-9caa-5d6be17cdd9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.448668 Aug 31 00:20:01.850848 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 83/169] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:20:01.856758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a250154c-8239-4a9f-8dee-e92b14f1039c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:01.857720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a250154c-8239-4a9f-8dee-e92b14f1039c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:01.966124 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a250154c-8239-4a9f-8dee-e92b14f1039c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:01.974277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a250154c-8239-4a9f-8dee-e92b14f1039c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1214 microversion: 2.1 time: 0.121648 Aug 31 00:20:01.975085 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 87/170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:01 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:02.604468 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:02.605169 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:02.611287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:02.611837 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:02.612334 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:02.613101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:02.613625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:02.614146 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:02.931974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:02.939814 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a0f833b3-1261-4c67-914d-f5ae0031a6e9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.339244 Aug 31 00:20:02.940383 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 84/171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:02 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:02.995196 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:02.995813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:03.001866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:03.002369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:03.002811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:03.003491 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:03.004520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:03.004950 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:03.069284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:03.076891 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a6ab645b-4719-4d01-af39-cd68126b954c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1218 microversion: 2.1 time: 0.085692 Aug 31 00:20:03.077431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 88/172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:02 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:03.961355 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:03.961989 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:03.967949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:03.968426 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:03.968858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:03.969538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:03.970070 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:03.970501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:04.099255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:04.099800 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:04.099922 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:04.106829 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:04.107458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:04.107896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1f6b9694-29f7-433f-b52f-042f737e0ad7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.150878 Aug 31 00:20:04.108076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:04.108654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 85/173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:03 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:04.109016 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:04.109728 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:04.110410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:04.172151 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:04.182765 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4f65291b-ff46-411e-8615-544dee3666f3 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1218 microversion: 2.1 time: 0.088204 Aug 31 00:20:04.183332 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 89/174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:04 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:05.128543 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:05.129110 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:05.135033 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:05.135509 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:05.135937 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:05.136614 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:05.137059 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:05.137476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:05.204628 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:05.205416 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:05.212291 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:05.212785 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:05.213229 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:05.214022 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:05.214481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:05.214907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:05.275790 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:05.282282 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:05.283995 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c3128ad3-b615-42f6-b32f-079748232c6f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.159280 Aug 31 00:20:05.285398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 86/175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:05 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:05.290721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-eef0fa97-1c53-4634-ae6e-fe36eb65fa5a tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1218 microversion: 2.1 time: 0.090050 Aug 31 00:20:05.291282 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 90/176] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:05 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:06.306578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:06.307191 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:06.311518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:06.312407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:06.313155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:06.313836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:06.314314 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:06.315167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:06.315773 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:06.316929 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:06.319714 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:06.320400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:06.320920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:06.321606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:06.322194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:06.322710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:06.393594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:06.401343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-750d99d2-e7bd-4cf0-bba8-2b6a7837adbc tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1266 microversion: 2.1 time: 0.093540 Aug 31 00:20:06.401798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 91/177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:06 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:06.468632 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:06.486387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5f51f5fe-41a6-4657-9c32-83c34215ab84 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a0b654b-5388-4153-aa88-528d816621f8"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:06.486918 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ef67673b-aa61-42c5-972b-ee1720b5afd7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.183983 Aug 31 00:20:06.487510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 87/178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:06 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:06.503475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5f51f5fe-41a6-4657-9c32-83c34215ab84 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:06.510221 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f51f5fe-41a6-4657-9c32-83c34215ab84 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:06.510996 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f51f5fe-41a6-4657-9c32-83c34215ab84 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:06.511979 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f51f5fe-41a6-4657-9c32-83c34215ab84 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:06.512877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f51f5fe-41a6-4657-9c32-83c34215ab84 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:06.513571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f51f5fe-41a6-4657-9c32-83c34215ab84 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:06.514231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5f51f5fe-41a6-4657-9c32-83c34215ab84 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:07.064938 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5f51f5fe-41a6-4657-9c32-83c34215ab84 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "POST /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584684 Aug 31 00:20:07.069931 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 92/179] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:20:06 2022] POST /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:20:07.424104 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:07.424792 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:07.431814 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:07.432234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:07.432673 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:07.433365 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:07.433873 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:07.434291 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:07.504506 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:07.509256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:07.509987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:07.512204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0381fac0-f133-41f2-8c48-6ca028249275 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1272 microversion: 2.1 time: 0.092282 Aug 31 00:20:07.516583 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:07.517269 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:07.517712 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:07.518434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:07.518891 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:07.519337 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:07.523837 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 88/180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:07 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:07.682226 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:07.687698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:07.697135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4603555d-a44c-4499-b60e-6a928c24e69d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.190896 Aug 31 00:20:07.698043 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 93/181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:07 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:08.465509 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-947dc7cf-fc3a-4f85-b0fe-d8d09615049e req-cd1081bc-700d-4f78-b56f-2d8fcfec630d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48fdc13-f2cc-463e-9958-87061254dbe0", "tag": "0f4d2a98-12dd-4398-9bf5-e2c24048dc08"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:08.475048 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-947dc7cf-fc3a-4f85-b0fe-d8d09615049e req-cd1081bc-700d-4f78-b56f-2d8fcfec630d service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:08.475515 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-947dc7cf-fc3a-4f85-b0fe-d8d09615049e req-cd1081bc-700d-4f78-b56f-2d8fcfec630d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:08.475936 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-947dc7cf-fc3a-4f85-b0fe-d8d09615049e req-cd1081bc-700d-4f78-b56f-2d8fcfec630d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:08.489722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-947dc7cf-fc3a-4f85-b0fe-d8d09615049e req-cd1081bc-700d-4f78-b56f-2d8fcfec630d service nova] Creating event network-changed:0f4d2a98-12dd-4398-9bf5-e2c24048dc08 for instance f48fdc13-f2cc-463e-9958-87061254dbe0 on hv-cinder-85220 Aug 31 00:20:08.495961 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-947dc7cf-fc3a-4f85-b0fe-d8d09615049e req-cd1081bc-700d-4f78-b56f-2d8fcfec630d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034073 Aug 31 00:20:08.496589 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 89/182] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:08.536471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:08.537080 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:08.544617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:08.545094 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:08.545529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:08.546249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:08.546698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:08.547117 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:08.674897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:08.682972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-49e89919-6f59-44b9-b290-766cb654a9b2 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1314 microversion: 2.1 time: 0.150367 Aug 31 00:20:08.683542 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 94/183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:08 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:08.719320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:08.720022 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:08.726669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:08.727152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:08.727591 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:08.728278 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:08.728730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:08.729153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:08.938989 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:08.946936 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6f90114f-36af-4cc8-acb6-36722b882886 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.231749 Aug 31 00:20:08.948080 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 90/184] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:08 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:09.707570 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:09.708193 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:09.714577 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:09.715067 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:09.715500 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:09.716487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:09.716948 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:09.717374 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:09.853830 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:09.861882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d87a510a-bca2-4119-a75f-5a3b289f5fdf tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1314 microversion: 2.1 time: 0.160889 Aug 31 00:20:09.870257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 95/185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:09 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:09.968563 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:09.969171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:09.975243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:09.975722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:09.976153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:09.976840 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:09.977289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:09.977708 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:10.114315 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:10.118074 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:10.123010 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ec011433-9594-4d3a-b0d3-a14d70886b82 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.158357 Aug 31 00:20:10.123572 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 91/186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:09 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:10.883168 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:10.883920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:10.893235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:10.893724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:10.894945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:10.897243 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:10.897700 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:10.898148 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:11.082941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:11.101760 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ddc4242b-03fb-4e12-b2f1-f4d1c590a765 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1314 microversion: 2.1 time: 0.222389 Aug 31 00:20:11.102383 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 96/187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:10 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:11.145875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:11.147818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:11.156319 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:11.157006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:11.157438 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:11.158406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:11.158938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:11.159361 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:11.307393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:11.317566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-82df076e-d4aa-48b5-a023-a314be92e227 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.176970 Aug 31 00:20:11.330483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 92/188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:11 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:12.123438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:12.124680 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:12.134958 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:12.140020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:12.141506 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:12.143059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:12.147959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:12.147959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:12.147959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:12.336050 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:12.337570 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=6 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:12.343256 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:12.346252 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:12.362587 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:12.364563 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:12.365295 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:12.368991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:12.370649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:12.371638 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:12.623901 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:12.633315 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-17486350-265f-44f4-8ebd-c6c367c3ce18 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.298156 Aug 31 00:20:12.640418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:12.646097 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 93/189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:12 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:12.654501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f0de0cb8-d86c-4849-8007-8ec8e7527218 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1314 microversion: 2.1 time: 0.535653 Aug 31 00:20:12.655434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 97/190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:12 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:13.665051 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:13.667052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:13.683293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:13.699565 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:13.731174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:13.732184 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:13.733073 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:13.734521 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:13.735260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:13.735939 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:13.738686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:13.739520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:13.740277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:13.741511 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:13.746804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:13.747681 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:13.969374 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:13.986000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fa9f00a4-a18b-4c87-b3b3-9bae506d63e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.331815 Aug 31 00:20:13.988274 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 94/191] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:13 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:14.008237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:14.008833 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:14.036724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:14.040937 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:14.041641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:14.045210 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:14.046670 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:14.048223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:14.119723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:20:14.137040 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:14.148312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7e71ad4f-5ecc-4151-bac3-4566f6cbe9a6 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1314 microversion: 2.1 time: 0.474541 Aug 31 00:20:14.148899 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 98/192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:13 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:14.328482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7b67cae8-7fdc-4208-a979-27e628f636ba tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "DELETE /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 204 len: 0 microversion: 2.1 time: 0.338030 Aug 31 00:20:14.329770 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 95/193] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:20:13 2022] DELETE /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:20:14.338599 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:14.339206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:14.353026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:14.358699 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:14.359324 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:14.360762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:14.361527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:14.362120 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:14.629062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:14.643536 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-33537fd0-12fd-4bcf-81bb-bda0e69f04ce tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1553 microversion: 2.1 time: 0.308729 Aug 31 00:20:14.645276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 99/194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:14 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1553 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:15.010618 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:15.011346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:15.019006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:15.019492 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:15.019929 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:15.020641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:15.021075 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:15.021494 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:15.177289 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:15.178630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:15.191497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:15.192434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:15.195055 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:15.198123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:15.200998 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:15.201774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:15.248612 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:15.257997 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-dc7a091d-0841-4ab8-8d1e-105f23842945 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.254088 Aug 31 00:20:15.274074 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 96/195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:15 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:15.469226 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:15.489248 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-77bbbc7f-4e74-4156-ad63-abdff0400026 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1314 microversion: 2.1 time: 0.319830 Aug 31 00:20:15.489861 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 100/196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:15 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:15.668130 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:15.668907 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:15.678197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:15.682260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:15.682909 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:15.683448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:15.685590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:15.685933 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:15.908279 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:15.920664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e3cf3c25-3597-4a4d-aad7-a15243b17562 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1553 microversion: 2.1 time: 0.256436 Aug 31 00:20:15.922393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 97/197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:15 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1553 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:16.027586 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-31797e1c-ffd9-45cc-8e34-08bdd6acfba1 req-e8916fc0-36e6-4f50-bb8e-95ae69d28ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48fdc13-f2cc-463e-9958-87061254dbe0", "name": "network-vif-plugged", "status": "completed", "tag": "0f4d2a98-12dd-4398-9bf5-e2c24048dc08"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:16.059585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-31797e1c-ffd9-45cc-8e34-08bdd6acfba1 req-e8916fc0-36e6-4f50-bb8e-95ae69d28ebb service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:16.061334 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-31797e1c-ffd9-45cc-8e34-08bdd6acfba1 req-e8916fc0-36e6-4f50-bb8e-95ae69d28ebb service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:16.062680 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-31797e1c-ffd9-45cc-8e34-08bdd6acfba1 req-e8916fc0-36e6-4f50-bb8e-95ae69d28ebb service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:16.096141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-31797e1c-ffd9-45cc-8e34-08bdd6acfba1 req-e8916fc0-36e6-4f50-bb8e-95ae69d28ebb service nova] Creating event network-vif-plugged:0f4d2a98-12dd-4398-9bf5-e2c24048dc08 for instance f48fdc13-f2cc-463e-9958-87061254dbe0 on hv-cinder-85220 Aug 31 00:20:16.109838 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-31797e1c-ffd9-45cc-8e34-08bdd6acfba1 req-e8916fc0-36e6-4f50-bb8e-95ae69d28ebb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089627 Aug 31 00:20:16.115312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 101/198] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:16.281064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:16.282804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:16.295129 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:16.295945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:16.296966 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:16.297828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:16.298941 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:16.299532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:16.462410 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:16.471077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f3236e0f-52ad-4b5c-b78f-b84a1e340ce7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.194251 Aug 31 00:20:16.471648 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 98/199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:16 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:16.512804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:16.514436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:16.524858 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:16.525529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:16.526013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:16.526715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:16.527487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:16.528677 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:16.738984 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:16.748086 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-eba88d5e-e8d5-4989-b248-6b374861a821 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1314 microversion: 2.1 time: 0.240973 Aug 31 00:20:16.748724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 102/200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:16 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:16.943023 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:16.943562 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:16.950919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:16.951613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:16.952226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:16.953226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:16.953932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:16.954494 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:17.420403 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:17.432471 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0df96831-f441-41f0-bbae-9d9c6e679759 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1553 microversion: 2.1 time: 0.493805 Aug 31 00:20:17.433375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 99/201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:16 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1553 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:17.492455 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:17.494200 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:17.503279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:17.504233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:17.504889 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:17.505813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:17.506379 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:17.506921 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:17.727025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:17.737315 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-61e4aed0-97c2-47d2-acbb-a7abe59fadf8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.248576 Aug 31 00:20:17.738649 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 103/202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:17 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:17.773676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:17.774392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:17.782836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:17.783397 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:17.784043 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:17.785006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:17.786141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:17.786798 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:18.177337 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:18.193764 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-747a792d-c556-4f7e-b1cf-425d34ed575f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1314 microversion: 2.1 time: 0.427487 Aug 31 00:20:18.206602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 100/203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:17 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:18.464649 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:18.466732 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:18.478730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:18.479218 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:18.479650 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:18.480342 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:18.486006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:18.486704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:18.764055 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:18.765302 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:18.772672 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:18.774329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:18.778502 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:18.779272 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:18.780008 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:18.780525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:18.784883 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:18.794341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-63d5f06a-3c95-49d5-8ca1-9f0d74bdadf6 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1553 microversion: 2.1 time: 0.341219 Aug 31 00:20:18.799544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 104/204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:18 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1553 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:19.150456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:19.166388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e8202946-aa35-4e05-a011-ee249452869e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.406213 Aug 31 00:20:19.182345 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 101/205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:18 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:19.216836 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:19.217571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:19.234674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:19.236036 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:19.236844 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:19.239336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:19.240256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:19.246447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:19.424006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:19.450294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2f6f653e-db1f-4ce2-8a4a-bd396f8b2e6c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1314 microversion: 2.1 time: 0.235328 Aug 31 00:20:19.452382 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 105/206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:19 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:19.827674 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:19.828894 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:19.838958 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:19.840860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:19.841788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:19.843858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:19.859262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:19.861888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:20.195279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:20.197440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:20.208127 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:20.209271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:20.210231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:20.211173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:20.211947 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:20.212523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:20.558092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:20.586055 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-96118d51-6faf-4e79-b282-0eb898bf462b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.399407 Aug 31 00:20:20.586813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 106/207] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:20 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:20.625970 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:20.628184 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:20.650883 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:20.653256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:20.653948 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:20.654846 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:20.658041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:20.658709 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:20.886663 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:20.896953 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-03184434-8e6e-418c-9423-ccb8d1c9739c tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1464 microversion: 2.1 time: 0.306952 Aug 31 00:20:20.900927 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 107/208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:20 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1464 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:20.924886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:20.959368 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-08b63939-3c9c-4cab-9a2c-7834e85f7f5b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1553 microversion: 2.1 time: 1.138586 Aug 31 00:20:20.970137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:20.970626 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:20.981340 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:20.982337 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 102/209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:19 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1553 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:20.982620 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:20.983074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:20.983792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:20.994158 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:20.994911 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:21.041983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:20:21.175617 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-089b55d1-f976-44d6-9066-f07cf55b4899 req-55267e41-36f1-47a0-b0e4-d51c0210645f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79afdc5d-5e48-40a0-a1f4-624fddd73fee", "name": "network-vif-deleted", "tag": "00b6ea8b-b25e-4fd9-bfcc-0ed942d7b29b"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:21.212607 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-089b55d1-f976-44d6-9066-f07cf55b4899 req-55267e41-36f1-47a0-b0e4-d51c0210645f service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:21.219176 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-089b55d1-f976-44d6-9066-f07cf55b4899 req-55267e41-36f1-47a0-b0e4-d51c0210645f service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:21.232412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-089b55d1-f976-44d6-9066-f07cf55b4899 req-55267e41-36f1-47a0-b0e4-d51c0210645f service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:21.257126 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-06efdfc8-b858-49e1-9efe-6f93a1d51aba tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 204 len: 0 microversion: 2.1 time: 0.290519 Aug 31 00:20:21.258453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 108/210] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:20:20 2022] DELETE /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:20:21.274773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:21.275486 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:21.276829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-089b55d1-f976-44d6-9066-f07cf55b4899 req-55267e41-36f1-47a0-b0e4-d51c0210645f service nova] Creating event network-vif-deleted:00b6ea8b-b25e-4fd9-bfcc-0ed942d7b29b for instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee on hv-cinder-85220 Aug 31 00:20:21.283117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-089b55d1-f976-44d6-9066-f07cf55b4899 req-55267e41-36f1-47a0-b0e4-d51c0210645f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111716 Aug 31 00:20:21.284439 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 103/211] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:21.295811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:21.296390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:21.297365 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:21.303101 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:21.304500 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:21.305237 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:21.379713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:21.579528 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:21.589220 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-975e9030-546a-4845-b117-6714be1c8b3f tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1470 microversion: 2.1 time: 0.321626 Aug 31 00:20:21.590365 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 109/212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:21 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:21.611897 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:21.615055 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:21.623234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:21.624306 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:21.624951 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:21.626061 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:21.626706 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:21.627483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:21.978112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:21.991968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4f0ec5c6-9a41-43c6-832d-4296bc1de691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.384788 Aug 31 00:20:21.994368 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 104/213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:21 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:22.012301 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:22.013196 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:22.020547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:22.022630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:22.026799 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:22.028024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:22.028794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:22.029398 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:22.167738 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:22.177223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4cce4768-baf9-4a4f-bc2b-e4906290c766 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1346 microversion: 2.1 time: 0.169626 Aug 31 00:20:22.181888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 110/214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:22 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1346 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:22.614525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:22.615135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:22.626602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:22.627097 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:22.630878 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:22.631940 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:22.633166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:22.633782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:22.881810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:22.891734 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-432fb237-1c16-49c5-adda-affe1335ea9e tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1470 microversion: 2.1 time: 0.281350 Aug 31 00:20:22.893708 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 105/215] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:22 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1470 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:23.019617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:23.020792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:23.025538 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:23.033188 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:23.034577 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:23.035721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:23.036735 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:23.037533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:23.038421 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:23.199164 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:23.200538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:23.209296 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:23.210728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:23.211416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:23.212048 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:23.212957 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:23.213791 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:23.214722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:23.234962 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7cecb87a-9dee-4e05-b337-53d7eb890148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.210231 Aug 31 00:20:23.236469 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 111/216] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:23 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:23.325237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:23.349084 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-22e1ebc1-7df5-444e-9315-a979d20ea08d tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1346 microversion: 2.1 time: 0.153640 Aug 31 00:20:23.350148 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 106/217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:23 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1346 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:23.915061 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:23.915983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:23.927958 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:23.929071 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:23.930571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:23.931590 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:23.932289 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:23.933264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:24.132020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:24.141061 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b2bbb99e-40d2-4afe-b81e-88d96bbc7cd8 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1470 microversion: 2.1 time: 0.229744 Aug 31 00:20:24.141990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 112/218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:23 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:24.269463 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:24.270997 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:24.281816 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:24.282717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:24.283774 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:24.285613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:24.286421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:24.287158 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:24.311565 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:24.371040 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:24.371944 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:24.379816 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:24.380747 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:24.381371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:24.383011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:24.383661 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:24.384270 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:24.455439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:24.459447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:24.460156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:24.461036 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lazy-loading 'fault' on Instance uuid 79afdc5d-5e48-40a0-a1f4-624fddd73fee {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:20:24.537596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced4ad031f324edb89eff6133fbf9543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258e6d65abf74a58af993ca946d98798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:24.545297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7c04d873-dac9-47cf-a9f5-3c7443287aa0 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 200 len: 1351 microversion: 2.1 time: 0.177973 Aug 31 00:20:24.552311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 113/219] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:24 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 1351 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:24.567970 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:24.577875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3c518a09-16a7-4bad-aa16-7d427b4c4cc3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.323813 Aug 31 00:20:24.582461 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 107/220] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:24 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:24.705778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-d40bf599-3911-434c-8eec-b4228b99ed3b req-336f736b-685d-44e6-9281-5d132c5e2acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48fdc13-f2cc-463e-9958-87061254dbe0", "name": "network-vif-deleted", "tag": "0f4d2a98-12dd-4398-9bf5-e2c24048dc08"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:24.738912 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-d40bf599-3911-434c-8eec-b4228b99ed3b req-336f736b-685d-44e6-9281-5d132c5e2acd service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:24.745008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-d40bf599-3911-434c-8eec-b4228b99ed3b req-336f736b-685d-44e6-9281-5d132c5e2acd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:24.745692 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-d40bf599-3911-434c-8eec-b4228b99ed3b req-336f736b-685d-44e6-9281-5d132c5e2acd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:24.773086 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-d40bf599-3911-434c-8eec-b4228b99ed3b req-336f736b-685d-44e6-9281-5d132c5e2acd service nova] Creating event network-vif-deleted:0f4d2a98-12dd-4398-9bf5-e2c24048dc08 for instance f48fdc13-f2cc-463e-9958-87061254dbe0 on hv-cinder-85220 Aug 31 00:20:24.784280 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-d40bf599-3911-434c-8eec-b4228b99ed3b req-336f736b-685d-44e6-9281-5d132c5e2acd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083626 Aug 31 00:20:24.785374 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 114/221] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:25.168135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:25.170150 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:25.179899 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:25.181834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:25.182482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:25.184276 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:25.185450 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:25.186066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:25.235405 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:25.235747 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:25.236251 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:25.236717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lazy-loading 'fault' on Instance uuid f48fdc13-f2cc-463e-9958-87061254dbe0 {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:20:25.307855 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd87db4f6344050b39048acdd3cdd56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15ffcbae924b52830ebc980091bf40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:25.318879 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b623a07e-8bc2-4f58-8f18-e681451b3253 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 200 len: 1304 microversion: 2.1 time: 0.156761 Aug 31 00:20:25.322353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 108/222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:25 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:25.571308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:25.572237 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:25.587161 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:25.592371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:25.593069 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:25.595221 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:25.595875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:25.597019 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:25.603105 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:25.604025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:25.619008 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:25.620614 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:25.621662 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:25.622237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:25.624258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:25.624829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:25.644901 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] HTTP exception thrown: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Request method failure captured: Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee HTTP/1.1 Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqj7l7GSI4Zq_DSk-ZmFAc5qoLc_Wy0jTjxD-7Hof0iuKWVEcMNVZC-qepuDKAJ_qZerXA6ByX3X9aTJhlWogiXnKr4Ehba6mzrZd3PMq9CYw_2qbAqV9v_6DtCD5wqeP-j7wpHCL4bdwKZ4q_-nyk7GSzD6LZlh4gyh4YVYiWAyvUA Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 258e6d65abf74a58af993ca946d98798 Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:20:25.654966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/258e6d65abf74a58af993ca946d98798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/258e6d65abf74a58af993ca946d98798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/258e6d65abf74a58af993ca946d98798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_258e6d65abf74a58af993ca946d98798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 258e6d65abf74a58af993ca946d98798 Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-DeleteServersTestJSON-438650427-project Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: ced4ad031f324edb89eff6133fbf9543 Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-DeleteServersTestJSON-438650427-project Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.656431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '79afdc5d-5e48-40a0-a1f4-624fddd73fee'} Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:25.657255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.658584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.660558 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Returning 404 to user: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:25.661978 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9558c226-9c89-4c42-a1ea-33a94eb07c9b tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 404 len: 111 microversion: 2.1 time: 0.098596 Aug 31 00:20:25.662540 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 115/223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:25 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:25.843943 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:25.846705 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:25.865887 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:25.866891 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:25.867543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:25.869805 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:25.872205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:25.872716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:25.902526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] HTTP exception thrown: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Request method failure captured: Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee/os-volume_attachments HTTP/1.1 Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqj7l7GSI4Zq_DSk-ZmFAc5qoLc_Wy0jTjxD-7Hof0iuKWVEcMNVZC-qepuDKAJ_qZerXA6ByX3X9aTJhlWogiXnKr4Ehba6mzrZd3PMq9CYw_2qbAqV9v_6DtCD5wqeP-j7wpHCL4bdwKZ4q_-nyk7GSzD6LZlh4gyh4YVYiWAyvUA Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 258e6d65abf74a58af993ca946d98798 Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:20:25.910429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/258e6d65abf74a58af993ca946d98798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/258e6d65abf74a58af993ca946d98798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/258e6d65abf74a58af993ca946d98798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_258e6d65abf74a58af993ca946d98798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 258e6d65abf74a58af993ca946d98798 Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-DeleteServersTestJSON-438650427-project Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: ced4ad031f324edb89eff6133fbf9543 Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-DeleteServersTestJSON-438650427-project Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.911981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'server_id': '79afdc5d-5e48-40a0-a1f4-624fddd73fee'} Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:25.912775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:25.914093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:25.920059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Returning 404 to user: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:25.920059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1ae12201-cba4-456a-8374-4ab6ea04bfa5 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.075421 Aug 31 00:20:25.920059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 116/224] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:20:25 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee/os-volume_attachments => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:25.925062 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:25.962123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cda33ab6-5a9e-409b-a176-ffecdd1ded59 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.362332 Aug 31 00:20:25.963406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 109/225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:25 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:26.355333 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:26.363073 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] [instance: f48fdc13-f2cc-463e-9958-87061254dbe0] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:26.388261 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:26.389167 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:26.390029 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:26.396660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:26.398524 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:26.399221 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:26.424518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] HTTP exception thrown: Instance f48fdc13-f2cc-463e-9958-87061254dbe0 could not be found. Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Request method failure captured: Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 HTTP/1.1 Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqkvMzPevSs9OLwwoIaxgaZBcJLdP8zDmvVctENtQCUUeLIdhMnQrsAPylQMqdLYAQzsRKFU4fV5vpDVuu6QpnzXY-Ugh9DkBQIBz7op52jlxTuohIDGw1m091APiEh_lQmiGXPvl1m7x5navPQNumZgiPYix26U6cfiXmugultNyq8 Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 9f15ffcbae924b52830ebc980091bf40 Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-VolumesNegativeTest-1116874233 Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:20:26.426132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9f15ffcbae924b52830ebc980091bf40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9f15ffcbae924b52830ebc980091bf40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9f15ffcbae924b52830ebc980091bf40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9f15ffcbae924b52830ebc980091bf40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-VolumesNegativeTest-1116874233 Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 9f15ffcbae924b52830ebc980091bf40 Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-VolumesNegativeTest-1116874233 Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-VolumesNegativeTest-1116874233-project Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: efd87db4f6344050b39048acdd3cdd56 Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-VolumesNegativeTest-1116874233-project Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance f48fdc13-f2cc-463e-9958-87061254dbe0 could not be found. Aug 31 00:20:26.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': 'f48fdc13-f2cc-463e-9958-87061254dbe0'} Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48fdc13-f2cc-463e-9958-87061254dbe0 could not be found. Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:26.428438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48fdc13-f2cc-463e-9958-87061254dbe0 could not be found. Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48fdc13-f2cc-463e-9958-87061254dbe0 could not be found. Aug 31 00:20:26.430427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:26.431716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] Returning 404 to user: Instance f48fdc13-f2cc-463e-9958-87061254dbe0 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:26.431716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8a4ebf57-4ea6-4fb8-a9a7-246f275b8a23 tempest-VolumesNegativeTest-1116874233 tempest-VolumesNegativeTest-1116874233-project] 10.222.0.49 "GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0" status: 404 len: 111 microversion: 2.1 time: 0.081215 Aug 31 00:20:26.431716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 117/226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:26 2022] GET /compute/v2.1/servers/f48fdc13-f2cc-463e-9958-87061254dbe0 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:26.995768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:26.997395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:26.999834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:27.013759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:27.015392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:27.016200 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:27.017199 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:27.017897 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:27.018618 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:27.256246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:27.257374 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:27.264693 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:27.267003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:27.267694 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:27.269917 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:27.270578 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:27.272660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:27.309859 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:27.324127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3cd8d6f9-bcc0-41fc-b7ac-9d37e7efe18b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.344222 Aug 31 00:20:27.324809 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 110/227] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:26 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:27.540043 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] HTTP exception thrown: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Request method failure captured: Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: DELETE /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee HTTP/1.1 Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqj7l7GSI4Zq_DSk-ZmFAc5qoLc_Wy0jTjxD-7Hof0iuKWVEcMNVZC-qepuDKAJ_qZerXA6ByX3X9aTJhlWogiXnKr4Ehba6mzrZd3PMq9CYw_2qbAqV9v_6DtCD5wqeP-j7wpHCL4bdwKZ4q_-nyk7GSzD6LZlh4gyh4YVYiWAyvUA Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 258e6d65abf74a58af993ca946d98798 Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:20:27.543743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/258e6d65abf74a58af993ca946d98798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/258e6d65abf74a58af993ca946d98798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/258e6d65abf74a58af993ca946d98798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_258e6d65abf74a58af993ca946d98798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 258e6d65abf74a58af993ca946d98798 Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-DeleteServersTestJSON-438650427-project Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: ced4ad031f324edb89eff6133fbf9543 Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-DeleteServersTestJSON-438650427-project Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.545219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '79afdc5d-5e48-40a0-a1f4-624fddd73fee'} Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:27.546041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.547527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.549110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Returning 404 to user: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:27.549110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-dead7b13-d8a2-4191-a890-4bf7a9361574 tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "DELETE /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 404 len: 111 microversion: 2.1 time: 0.294315 Aug 31 00:20:27.551790 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 118/228] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:20:27 2022] DELETE /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 111 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:27.555966 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:27.556746 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] [instance: 79afdc5d-5e48-40a0-a1f4-624fddd73fee] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:27.566331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:27.571931 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:27.572573 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:27.574103 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:27.575963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:27.576552 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:27.621463 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] HTTP exception thrown: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Request method failure captured: Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee HTTP/1.1 Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj7l7GSI4Zq_DSk-ZmFAc5qoLc_Wy0jTjxD-7Hof0iuKWVEcMNVZC-qepuDKAJ_qZerXA6ByX3X9aTJhlWogiXnKr4Ehba6mzrZd3PMq9CYw_2qbAqV9v_6DtCD5wqeP-j7wpHCL4bdwKZ4q_-nyk7GSzD6LZlh4gyh4YVYiWAyvUA Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 258e6d65abf74a58af993ca946d98798 Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:20:27.629246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/258e6d65abf74a58af993ca946d98798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/258e6d65abf74a58af993ca946d98798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/258e6d65abf74a58af993ca946d98798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_258e6d65abf74a58af993ca946d98798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 258e6d65abf74a58af993ca946d98798 Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-DeleteServersTestJSON-438650427 Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-DeleteServersTestJSON-438650427-project Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: ced4ad031f324edb89eff6133fbf9543 Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-DeleteServersTestJSON-438650427-project Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.630766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '79afdc5d-5e48-40a0-a1f4-624fddd73fee'} Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:27.631611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. Aug 31 00:20:27.632948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:27.635559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] Returning 404 to user: Instance 79afdc5d-5e48-40a0-a1f4-624fddd73fee could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:27.636608 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3435c489-5853-4dd2-a639-70f31776afad tempest-DeleteServersTestJSON-438650427 tempest-DeleteServersTestJSON-438650427-project] 10.222.0.49 "GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee" status: 404 len: 111 microversion: 2.1 time: 0.085006 Aug 31 00:20:27.637628 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 111/229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:27 2022] GET /compute/v2.1/servers/79afdc5d-5e48-40a0-a1f4-624fddd73fee => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:20:28.354604 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:28.356900 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:28.389706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:28.390230 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:28.391308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:28.394346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:28.399441 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:28.400145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:29.353405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:29.368945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ab34616f-30bb-4c08-a182-50a15878afef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 1.017078 Aug 31 00:20:29.369588 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 119/230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:28 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:30.415896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:30.416778 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:30.454876 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:30.458358 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:30.459511 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:30.460294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:30.470341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:30.471886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:30.822412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:30.836570 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f3b6f7fb-2333-4684-989a-39e8403f66b4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.445504 Aug 31 00:20:30.840959 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 112/231] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:30 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:31.884442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:31.891031 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:31.903577 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:31.904253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:31.904867 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:31.905749 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:31.906389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:31.907605 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:32.312165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:32.327632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ed2fbde7-4afa-4b0e-bd8e-9b326271c4da tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.468202 Aug 31 00:20:32.329136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 120/232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:31 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:33.360947 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:33.362892 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:33.384587 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:33.385824 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:33.387123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:33.392073 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:33.397263 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:33.398029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:33.781823 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:33.801193 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-973519c0-a78d-44c3-9924-956dd55eb635 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.449651 Aug 31 00:20:33.802638 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 113/233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:33 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:34.838171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:34.839338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:34.850166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:34.850895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:34.851984 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:34.853788 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:34.854290 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:34.854722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:35.036458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:35.046231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f3239bef-fa06-4e5e-82f1-a239d295c2be tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.213078 Aug 31 00:20:35.046810 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 121/234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:34 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:35.475638 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f9a769a2-e6f3-4128-9379-8d077f8f6dc0 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Action: 'create', calling method: .version_select at 0x7fcd6bfa7790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1904437517", "metadata": {"Type": "work"}}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:35.907905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f9a769a2-e6f3-4128-9379-8d077f8f6dc0 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.571558 Aug 31 00:20:35.913213 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 114/235] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 31 00:20:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 575 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 00:20:35.921081 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0d42f5a3-bc79-44e1-b8ff-962d11f22dd2 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Calling method '.version_select at 0x7fcd70038a60>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:35.991339 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0d42f5a3-bc79-44e1-b8ff-962d11f22dd2 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497" status: 200 len: 353 microversion: 2.1 time: 0.074033 Aug 31 00:20:35.991895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 122/236] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:35 2022] GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:36.069071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:36.069828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:36.077076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:36.083269 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:36.083864 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:36.084831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:36.085505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:36.086212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:36.229904 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:36.241374 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-31f4549e-b649-4c2f-9f77-0934dd0941cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.176972 Aug 31 00:20:36.241976 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 115/237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:36 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:37.005002 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c52c56c3-07cb-4b3a-81b2-d9d916475f66 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Calling method '.version_select at 0x7fcd6bf89d30>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:37.064245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c52c56c3-07cb-4b3a-81b2-d9d916475f66 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497" status: 200 len: 353 microversion: 2.1 time: 0.063458 Aug 31 00:20:37.064919 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 123/238] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:36 2022] GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:37.264421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:37.265654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:37.272505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:37.273181 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:37.273767 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:37.274637 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:37.275246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:37.275842 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:37.412619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:37.420546 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-26af5472-af7a-487d-b11d-3640666f046d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.159914 Aug 31 00:20:37.421117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 116/239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:37 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:38.082989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d580e324-380b-4dff-a1cc-ca62853158a9 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Calling method '.version_select at 0x7fcd6bf898b0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:38.137674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d580e324-380b-4dff-a1cc-ca62853158a9 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497" status: 200 len: 353 microversion: 2.1 time: 0.063446 Aug 31 00:20:38.138682 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 124/240] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:38 2022] GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:38.442171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:38.443548 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:38.450121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:38.450609 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:38.451074 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:38.451769 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:38.452218 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:38.452649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:38.594530 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:38.628328 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2368783e-63ac-458d-9eef-f58e692c09ff tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.190202 Aug 31 00:20:38.628992 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 117/241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:38 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:39.152174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-09b4efa7-f9d2-4cae-a2b3-c033a8e3203a tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Calling method '.version_select at 0x7fcd6bffd550>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:39.193241 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cd28318e-57d9-490a-a40c-563a6fa7d62d tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Action: 'create', calling method: .version_select at 0x7fcd6bf0eee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-926676976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtW9BNp5z5gqPRMZWcbYFzT4Wmk3NiaFyxT+TOM7E+L19DUe0cBIekgsovLpFyyfmzvGqlAoqad3cJbnMVZIsmEV+9vYIX8dNATKf6iSg92Jsy1aBuVE33mA/V0709xYQ=="}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:39.201811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-09b4efa7-f9d2-4cae-a2b3-c033a8e3203a tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497" status: 200 len: 353 microversion: 2.1 time: 0.053865 Aug 31 00:20:39.202422 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 125/242] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:39 2022] GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:39.212639 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-cd28318e-57d9-490a-a40c-563a6fa7d62d tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Getting quotas for project 96ac355089a14695a3e062290443283e. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:39.216425 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-cd28318e-57d9-490a-a40c-563a6fa7d62d tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Getting quotas for user cdd2a01bf81d406e877a1c4ace635704 and project 96ac355089a14695a3e062290443283e. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:39.252662 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cd28318e-57d9-490a-a40c-563a6fa7d62d tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063108 Aug 31 00:20:39.253258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 118/243] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:20:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:20:39.348026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-704481757", "imageRef": "f7d01c58-a8a8-46f5-9d8a-f7481f427854", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-926676976", "networks": [{"uuid": "209e0849-b990-4163-974b-cd0bd02008ab"}]}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:39.399343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] validate_networks() for [('209e0849-b990-4163-974b-cd0bd02008ab', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:39.648833 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:39.649395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:39.655457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:39.655944 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:39.656377 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:39.657066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:39.657516 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:39.657987 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:39.764976 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:39.765727 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:39.766281 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:39.766842 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:39.767335 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:39.776961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:39.777515 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:39.778053 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:39.778896 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:39.779458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:39.779947 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:39.792337 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:39.798623 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Getting quotas for project 96ac355089a14695a3e062290443283e. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:39.800496 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4d19b585-5191-4e96-a6d7-dbe922fa1bf3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1522 microversion: 2.1 time: 0.155699 Aug 31 00:20:39.801141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 119/244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:39 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:39.802872 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Getting quotas for user cdd2a01bf81d406e877a1c4ace635704 and project 96ac355089a14695a3e062290443283e. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:39.814250 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:39.817006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f7d01c58-a8a8-46f5-9d8a-f7481f427854',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:39.866366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-789d69f5-76c1-4c00-86eb-e3b62f47d0b7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522172 Aug 31 00:20:39.867343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 126/245] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:20:39.878715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-517ed53f-4a53-401d-9020-9aeac318cb6d tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:39.879524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-517ed53f-4a53-401d-9020-9aeac318cb6d tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:39.935143 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-517ed53f-4a53-401d-9020-9aeac318cb6d tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:39.943305 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-517ed53f-4a53-401d-9020-9aeac318cb6d tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1257 microversion: 2.1 time: 0.069349 Aug 31 00:20:39.944212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 120/246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:39 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:40.218582 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-03745f56-e615-4ab4-9f6b-7b4866377091 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Calling method '.version_select at 0x7fcd6bfddaf0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:40.308158 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-03745f56-e615-4ab4-9f6b-7b4866377091 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497" status: 200 len: 354 microversion: 2.1 time: 0.096880 Aug 31 00:20:40.308939 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 127/247] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:40 2022] GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:40.321676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c962c684-597b-43d5-8399-40d1d75bc58e tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Calling method '.version_select at 0x7fcd6bf373a0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:40.391540 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c962c684-597b-43d5-8399-40d1d75bc58e tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497" status: 200 len: 354 microversion: 2.1 time: 0.074308 Aug 31 00:20:40.392109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 121/248] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:40 2022] GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:40.410917 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-abb9ee2a-c8bb-47f0-8b57-6aa961b704ff tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Calling method '.version_select at 0x7fcd6bffd4c0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:40.479704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-abb9ee2a-c8bb-47f0-8b57-6aa961b704ff tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497" status: 202 len: 0 microversion: 2.1 time: 0.074094 Aug 31 00:20:40.480743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 128/249] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:20:40 2022] DELETE /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:20:40.488920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fec11373-5db5-42f7-8a53-f8707612093a tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Calling method '.version_select at 0x7fcd6bf370d0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:40.540975 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fec11373-5db5-42f7-8a53-f8707612093a tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497" status: 200 len: 353 microversion: 2.1 time: 0.056325 Aug 31 00:20:40.542006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 122/250] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:40 2022] GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:20:40.820241 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:40.820870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:40.826997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:40.827495 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:40.827902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:40.828585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:40.829038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:40.829464 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:40.964903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:40.966077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:40.973187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:40.973591 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:40.974049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:40.974888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:40.975336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:40.975750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:41.040286 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:41.059656 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-57e08a6f-5333-4eca-a533-95edb2d98aa4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1502 microversion: 2.1 time: 0.243161 Aug 31 00:20:41.061308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 129/251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:40 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:41.069422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:41.089822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:41.091233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:41.091838 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7f8f531f-0f38-4094-8e7c-b95d0f34cb96 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1261 microversion: 2.1 time: 0.129519 Aug 31 00:20:41.092423 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 123/252] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:40 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1261 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:41.101480 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:41.102077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:41.102547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:41.103405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:41.105148 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:41.105877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:41.262319 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:41.290332 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0994549d-9bf5-4f39-9231-67306e1f5fe3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1516 microversion: 2.1 time: 0.208515 Aug 31 00:20:41.291552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 130/253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:41 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:41.558834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7065f72c-5df8-48d4-a696-7fc47d6c9093 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Calling method '.version_select at 0x7fcd6bf0ec10>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:41.671554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-7065f72c-5df8-48d4-a696-7fc47d6c9093 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] HTTP exception thrown: Volume dad574bb-3b65-4119-b3ac-1aa65d4e6497 could not be found. Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7065f72c-5df8-48d4-a696-7fc47d6c9093 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Request method failure captured: Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 HTTP/1.1 Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqlThxUdWNpeewK6ihmeZjlW4katHWdgZvG92CGvC-otKcNqzjFDugGAucPeEoq3AuTHB4jXzuVzsnBleibfmbdt8O0YVIJPFxkNYCqqroIm2r4fF2b1JBJKqsxHmUo-x5mD8RQVR6c0iRryqvibZ5EWkMFxzjr6X79hBjtO08hS0VE Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: a6a04d28f69a48efb5e2c3a3c1b4458a Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-VolumesGetTestJSON-207707838 Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:20:41.676534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6a04d28f69a48efb5e2c3a3c1b4458a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6a04d28f69a48efb5e2c3a3c1b4458a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6a04d28f69a48efb5e2c3a3c1b4458a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6a04d28f69a48efb5e2c3a3c1b4458a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-VolumesGetTestJSON-207707838 Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: a6a04d28f69a48efb5e2c3a3c1b4458a Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-VolumesGetTestJSON-207707838 Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-VolumesGetTestJSON-207707838-project Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: d519df0c72d14da9a735a450f492b947 Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-VolumesGetTestJSON-207707838-project Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Volume dad574bb-3b65-4119-b3ac-1aa65d4e6497 could not be found. Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': 'dad574bb-3b65-4119-b3ac-1aa65d4e6497'} Aug 31 00:20:41.677869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dad574bb-3b65-4119-b3ac-1aa65d4e6497 could not be found. (HTTP 404) (Request-ID: req-e2654e3e-119b-453a-b75e-3455c24baf2b) Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:41.678780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:20:41.679874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dad574bb-3b65-4119-b3ac-1aa65d4e6497 could not be found. Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:20:41.680906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dad574bb-3b65-4119-b3ac-1aa65d4e6497 could not be found. Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dad574bb-3b65-4119-b3ac-1aa65d4e6497 could not be found. Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7065f72c-5df8-48d4-a696-7fc47d6c9093 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] Returning 404 to user: Volume dad574bb-3b65-4119-b3ac-1aa65d4e6497 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7065f72c-5df8-48d4-a696-7fc47d6c9093 tempest-VolumesGetTestJSON-207707838 tempest-VolumesGetTestJSON-207707838-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497" status: 404 len: 109 microversion: 2.1 time: 0.126460 Aug 31 00:20:41.682027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 124/254] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:20:41 2022] GET /compute/v2.1/os-volumes/dad574bb-3b65-4119-b3ac-1aa65d4e6497 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:42.122653 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:42.123357 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:42.129477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:42.130361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:42.131007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:42.131949 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:42.132810 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:42.133445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:42.207615 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:42.216250 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d3c0226a-1432-4c54-bd0b-569fafe68def tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1317 microversion: 2.1 time: 0.097315 Aug 31 00:20:42.216834 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 131/255] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:42 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1317 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:42.853574 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:42.857350 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:42.867005 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:42.867821 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:42.868543 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:42.870057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:42.870825 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:42.872650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:42.926612 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lazy-loading 'flavor' on Instance uuid 6b85b900-da07-4c75-b7f3-4d0681c11d3a {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:20:43.225813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2921be72-4a1f-4da7-add2-65c71fad6862 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a/action" status: 200 len: 32 microversion: 2.1 time: 0.371107 Aug 31 00:20:43.227704 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 125/256] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:20:42 2022] POST /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a/action => generated 32 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:20:43.242229 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:43.242870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:43.244223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:43.248559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:43.273452 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:43.276985 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:43.278647 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:43.279393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:43.283567 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:43.284384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:43.288722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:43.290583 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:43.291045 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:43.302153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:43.304494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:43.305360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:43.628185 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:43.651810 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2da13513-a975-4764-88e1-a5bc155ab9d7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.403822 Aug 31 00:20:43.652480 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 132/257] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:43 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:43.950947 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:43.960324 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5c5f8ee3-a5fd-4ab3-8d7a-f36f9aefbf36 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.724008 Aug 31 00:20:43.960851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 126/258] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:43 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:44.578192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-192348548", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "networks": [{"uuid": "755938eb-dd0e-4f83-9aaf-3ed1966456ce"}]}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:44.681906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:44.682412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:44.686435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] validate_networks() for [('755938eb-dd0e-4f83-9aaf-3ed1966456ce', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:20:44.688871 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:44.690486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:44.691371 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:44.692254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:44.692855 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:44.693617 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:44.936310 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:44.956225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-48573955-a9c3-4a7b-aa69-dfc3a53e82d5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.279430 Aug 31 00:20:44.957742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 127/259] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:44 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:44.989644 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:44.990689 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:44.999842 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:45.002435 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:45.008237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:45.008964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:45.009439 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:45.009889 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:45.043575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:45.276269 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:45.299184 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d72bba14-fc24-4100-bfdd-186c51260ab2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.313930 Aug 31 00:20:45.314021 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 128/260] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:44 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:45.521513 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:20:45.521958 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:20:45.522431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:20:45.522850 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:20:45.523255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:20:45.538012 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:45.538577 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:45.539041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:45.539902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:45.540361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:45.540857 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:45.590176 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Getting quotas for project 80dbc22f8641481291939540b00e0225. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:20:45.596811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Getting quotas for user 4e57290be8d341db824952c83703b118 and project 80dbc22f8641481291939540b00e0225. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:20:45.620364 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:20:45.624547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:20:45.734215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-aef565c0-2156-4f8e-9c95-914ae96f4033 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161671 Aug 31 00:20:45.735267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 133/261] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:20:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:20:45.747028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b950c2b2-6913-4851-bcd2-89a857d19fde tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:45.747722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b950c2b2-6913-4851-bcd2-89a857d19fde tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:45.832388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b950c2b2-6913-4851-bcd2-89a857d19fde tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:45.843999 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b950c2b2-6913-4851-bcd2-89a857d19fde tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1218 microversion: 2.1 time: 0.101600 Aug 31 00:20:45.845166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 129/262] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:45 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:45.981628 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:45.982461 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:46.008158 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.014914 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.015392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.016140 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.016608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.017041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.222695 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:46.251773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-90f98447-eeac-4dc5-81fa-010f2288779f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.271366 Aug 31 00:20:46.252454 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 134/263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:45 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:46.325574 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:46.327012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:46.334841 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.335679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.336448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.337411 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.338411 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.339141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.631219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:46.639883 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-67324316-faf5-47de-b77f-24361737f35a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.321696 Aug 31 00:20:46.640469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 130/264] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:46 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:46.869178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:46.870192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:46.878438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.878884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.879526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.880233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:46.880686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:46.881113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:46.997113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:47.008929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9fc9b932-c9f4-4666-b830-8b773aeff1f5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1222 microversion: 2.1 time: 0.147808 Aug 31 00:20:47.009788 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 135/265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:46 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:47.273250 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:47.273877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:47.280782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.281587 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.281988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.282693 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.283355 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.283773 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.446944 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:47.478897 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-14e64f10-84a3-41aa-8d40-35fc79e99ef0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.209399 Aug 31 00:20:47.490171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 131/266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:47 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:47.663985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:47.665018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:47.682518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.683125 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.683580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.684434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:47.685078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:47.685508 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:47.710853 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:47.846204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:47.857084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-48327a35-9a38-4983-ab38-4871e20a3d55 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.195421 Aug 31 00:20:47.858026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 136/267] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:47 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:48.029406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:48.030106 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:48.038109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:48.039386 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:48.040251 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:48.041694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:48.042404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:48.043039 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:48.152325 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:48.161182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-df210c1d-7752-40b8-b5e9-76ca997d95f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1222 microversion: 2.1 time: 0.135493 Aug 31 00:20:48.162851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 132/268] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:48 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:48.502360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:48.502985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:48.511610 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:48.514534 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:48.516590 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:48.518174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:48.518857 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:48.519522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:48.835521 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:48.843863 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d3b11d87-2a0a-477e-9755-52492bc9c894 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.345903 Aug 31 00:20:48.844738 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 137/269] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:48 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:48.877647 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:48.878392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:48.893697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:48.895697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:48.896196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:48.896916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:48.900070 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:48.900711 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:49.101417 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:49.115210 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6d6f733c-a561-4586-a4df-843cff8839e4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.240493 Aug 31 00:20:49.117730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 133/270] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:48 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:49.188233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:49.189329 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:49.196335 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.197190 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.197688 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:49.198869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.199528 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.200019 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:49.278596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:49.286828 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3c0a1962-b978-4c6a-ab48-2b51bf663a93 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1222 microversion: 2.1 time: 0.107051 Aug 31 00:20:49.287398 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 138/271] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:49 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:49.867580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:49.868517 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:49.878133 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.878924 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.879042 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:49.886780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:49.887706 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:49.889111 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:50.139907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:50.140794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:50.152073 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:50.152851 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:50.154286 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:50.155222 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:50.156035 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:50.156623 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:50.192757 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:50.212454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b4eac0d1-1cf6-47b2-a5b1-17e79dd6756b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.345068 Aug 31 00:20:50.213406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 134/272] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:49 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:50.309720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:50.311542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:50.321143 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:50.329554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:50.329554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:50.329554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:50.329554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:50.330895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:50.421453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:50.455281 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c6ddce3c-6bd9-46ea-b99b-ac0a54681854 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.319294 Aug 31 00:20:50.456722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 139/273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:50 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:50.528732 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:50.537787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c9bb2ea9-2775-45b6-8ca8-f934f902599e tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1222 microversion: 2.1 time: 0.233442 Aug 31 00:20:50.540574 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 135/274] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:50 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1222 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:51.240448 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:51.241221 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:51.248081 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.248572 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.249156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.249889 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.250353 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.250774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.394773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:51.403111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d91efe38-11f2-4274-b013-00bece6681ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.167876 Aug 31 00:20:51.403580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 140/275] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:51 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:51.482518 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:51.483267 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:51.490916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.491399 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.491832 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.492521 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.492968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.493392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.560544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:51.561155 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:51.567428 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.567911 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.568345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.569038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:51.569488 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:51.570119 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:51.634015 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:51.648004 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f1c8bcf1-9bd1-49a5-9351-2c4db0c74509 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.169440 Aug 31 00:20:51.648675 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 136/276] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:51 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:51.659333 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:51.667297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f1426043-5f48-4d40-9aed-9b2913f92816 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1222 microversion: 2.1 time: 0.110609 Aug 31 00:20:51.667866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 141/277] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:51 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:52.425380 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:52.426099 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:52.432074 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.432555 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.432993 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:52.433678 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.434172 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.434604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:52.591890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:52.600259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2176f9cd-44bd-46a8-92c6-3fe95e5e14cd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.179533 Aug 31 00:20:52.601468 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 137/278] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:52 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:52.672862 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:52.673512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:52.680105 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.680619 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.681059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:52.681758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.682238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.682662 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:52.690836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:52.692189 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:52.699969 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.700795 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.701302 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:52.702418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:52.703297 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:52.703994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:52.771318 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:52.779122 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-13d8af4e-b9a3-4752-bc6f-d7c2ac7b8653 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1222 microversion: 2.1 time: 0.092684 Aug 31 00:20:52.779707 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 138/279] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:52 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:52.842006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:52.852467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-049e3994-a38b-4a20-8b47-5fd39fcafb08 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.183477 Aug 31 00:20:52.866780 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 142/280] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:52 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:53.418492 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-52437d2a-52f1-4bb1-b7c7-44952c6e5645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:53.418978 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-52437d2a-52f1-4bb1-b7c7-44952c6e5645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:53.425938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52437d2a-52f1-4bb1-b7c7-44952c6e5645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.426420 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52437d2a-52f1-4bb1-b7c7-44952c6e5645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.426846 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52437d2a-52f1-4bb1-b7c7-44952c6e5645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.427550 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52437d2a-52f1-4bb1-b7c7-44952c6e5645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.427992 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52437d2a-52f1-4bb1-b7c7-44952c6e5645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.428408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52437d2a-52f1-4bb1-b7c7-44952c6e5645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.611641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-52437d2a-52f1-4bb1-b7c7-44952c6e5645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/ips" status: 200 len: 151 microversion: 2.20 time: 0.196418 Aug 31 00:20:53.620320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 139/281] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 31 00:20:53 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/ips => generated 151 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:20:53.621345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:53.622267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:53.624894 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:53.633627 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.634839 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.635759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.636733 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.637407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.638287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.805919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:53.806473 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:53.820276 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.820833 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.821244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.822391 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.823258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.823871 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.883471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:53.893801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-84e63636-0e62-4c4c-b5e6-58a585fee8db tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.277121 Aug 31 00:20:53.894868 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 143/282] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:53 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:53.900763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:53.906818 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:53.919901 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.920504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.921242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.922106 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:53.922988 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:53.923616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:53.961446 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:53.971227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6ab9ddc0-1f03-4acf-80b1-434bcb258ba5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1222 microversion: 2.1 time: 0.172871 Aug 31 00:20:53.973901 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 140/283] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:53 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1222 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:54.228967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:54.236824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-43d149a5-c9ab-49cf-baaf-787a2a961578 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.340537 Aug 31 00:20:54.237386 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 144/284] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:53 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:54.917084 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:54.917489 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:54.924449 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:54.925012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:54.925451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:54.926322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:54.926784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:54.927289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:54.999038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:54.999824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:55.007029 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.007591 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.008098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.008863 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.009407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.010031 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.071310 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:55.078173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:55.079375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8bac5090-17fb-4084-9805-e99169b5f34f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.166562 Aug 31 00:20:55.081834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 141/285] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:54 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:55.085935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f04f76ae-4b25-4466-a5fc-ba33639eebaf tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1222 microversion: 2.1 time: 0.091936 Aug 31 00:20:55.098323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 145/286] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:54 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:55.256685 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:55.257286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:55.263338 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.264462 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.265200 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.265925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:55.266404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:55.266823 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:55.431155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:55.447381 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3d732589-deab-477b-8332-71c123002351 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.194022 Aug 31 00:20:55.448728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 142/287] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:55 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:56.101635 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.102195 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:56.103651 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=4 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:56.104434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=12 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:56.107319 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.108062 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:56.111084 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=8 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:56.120364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.121084 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.122128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.122990 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.123439 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.123918 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.125731 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.128593 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.129574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.132039 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.132539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.134446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.217878 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:56.229925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4e8492cc-b310-4f83-97fe-03cb8a5682f9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1222 microversion: 2.1 time: 0.126750 Aug 31 00:20:56.230808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 143/288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:56.309272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:56.316975 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a92807c1-3141-4ad3-91ae-74b9c047a9a9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.220045 Aug 31 00:20:56.317551 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 146/289] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:56.468651 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:56.469415 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:56.475522 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.476214 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.476651 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.484769 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:56.485476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:56.486469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:56.732510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:56.754782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b2b7a0e1-22f9-4e8e-bec2-32e041261942 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.289892 Aug 31 00:20:56.755991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 144/290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:56 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:57.255005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:57.255706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:57.262384 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.262733 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.263099 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.263919 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.264533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.264958 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.340230 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.341501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:57.342143 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:57.349796 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a2f76f9f-41a9-469a-8583-b30000cfd0e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1270 microversion: 2.1 time: 0.099251 Aug 31 00:20:57.350773 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:57.351405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 147/291] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:57 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:57.354694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.355797 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.356577 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.357787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.358651 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.359416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.390895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-bec5ec9e-191d-4655-9571-ebc8df9c9df0 req-d5bb19d2-7eed-473b-a33a-711f2b50a78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcf0da7-a91d-495a-a34e-88095698fb1a", "tag": "fa6d8697-5c97-4a6e-a066-a4a09dee4e61"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:57.405019 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-bec5ec9e-191d-4655-9571-ebc8df9c9df0 req-d5bb19d2-7eed-473b-a33a-711f2b50a78b service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.405381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-bec5ec9e-191d-4655-9571-ebc8df9c9df0 req-d5bb19d2-7eed-473b-a33a-711f2b50a78b service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.405805 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-bec5ec9e-191d-4655-9571-ebc8df9c9df0 req-d5bb19d2-7eed-473b-a33a-711f2b50a78b service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.417937 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-bec5ec9e-191d-4655-9571-ebc8df9c9df0 req-d5bb19d2-7eed-473b-a33a-711f2b50a78b service nova] Creating event network-changed:fa6d8697-5c97-4a6e-a066-a4a09dee4e61 for instance 8dcf0da7-a91d-495a-a34e-88095698fb1a on hv-cinder-85220 Aug 31 00:20:57.424487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-bec5ec9e-191d-4655-9571-ebc8df9c9df0 req-d5bb19d2-7eed-473b-a33a-711f2b50a78b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037533 Aug 31 00:20:57.426587 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 148/292] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:20:57.543952 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.554138 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-dae14438-1dfe-4112-9008-f33854028ceb tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.217463 Aug 31 00:20:57.555155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 145/293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:57 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:57.781586 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:57.782315 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:57.788945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.789425 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.790003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.790695 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:57.791145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:57.791568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:57.937411 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:57.945724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-85ad6dde-d0cb-4aff-9d2e-b095bbcecca7 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.168413 Aug 31 00:20:57.946325 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 149/294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:57 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:58.378863 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:58.379472 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:58.390198 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.390907 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.391505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.393715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.394969 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.395772 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.429508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:58.552082 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:58.570065 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0668b419-a0bf-492c-975a-17723879b3de tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1276 microversion: 2.1 time: 0.188850 Aug 31 00:20:58.579276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:58.580435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:58.584881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 146/295] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:58 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:58.587679 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.588254 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.589458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.590317 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.590992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.591656 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.848021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:58.859002 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-12c4447b-5f19-47bf-b822-8c2056c501bc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.284904 Aug 31 00:20:58.859714 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 150/296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:58 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:58.971864 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:58.972540 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:58.981829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.982384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.982828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:58.983543 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:58.984021 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:58.984435 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.208260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:59.218386 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3ace31f0-b972-458f-a4d0-d06022ee4846 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.253600 Aug 31 00:20:59.219422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 147/297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:58 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:20:59.366400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:20:59.366985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:59.373341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.374495 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.374960 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.375690 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.376271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.376616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.401474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lazy-loading 'flavor' on Instance uuid 28862807-4ab6-4376-9e01-b40cd4e4483a {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:20:59.506280 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:59.589649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:59.591442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:59.600374 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.601456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.602632 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.603555 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.604547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.605203 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.729554 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5254bee7-1a0c-4420-bd87-2771e2e7949d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/action" status: 202 len: 0 microversion: 2.20 time: 0.367435 Aug 31 00:20:59.733632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 151/298] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 31 00:20:59 2022] POST /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:20:59.740571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:59.741380 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:59.754105 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.754982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.757084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.759354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.760309 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.768663 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.885020 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:20:59.915632 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-90be7785-51c1-4321-92a2-55c33b1c9ad1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.331525 Aug 31 00:20:59.931557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 148/299] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:59 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:20:59.942834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:20:59.945104 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:20:59.954566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.955825 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.956673 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:20:59.957584 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:20:59.958264 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:20:59.958889 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.014860 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.026650 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.028403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.030552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7507f44b-d031-4665-b3a6-a741e3969330 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.294797 Aug 31 00:21:00.032285 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 152/300] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:20:59 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:00.037659 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-3966f702-ae22-4520-bb91-f53f9bf386c6 req-aa687903-7359-4a85-bcdd-b31d87e318bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad2ac443-640c-4200-b515-84ee80e2ef9b", "tag": "77f81145-8f7a-4f02-886d-93eaf00ce9b6"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:00.053073 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-3966f702-ae22-4520-bb91-f53f9bf386c6 req-aa687903-7359-4a85-bcdd-b31d87e318bf service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.053806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-3966f702-ae22-4520-bb91-f53f9bf386c6 req-aa687903-7359-4a85-bcdd-b31d87e318bf service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.054547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-3966f702-ae22-4520-bb91-f53f9bf386c6 req-aa687903-7359-4a85-bcdd-b31d87e318bf service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.073751 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-3966f702-ae22-4520-bb91-f53f9bf386c6 req-aa687903-7359-4a85-bcdd-b31d87e318bf service nova] Creating event network-changed:77f81145-8f7a-4f02-886d-93eaf00ce9b6 for instance ad2ac443-640c-4200-b515-84ee80e2ef9b on hv-cinder-85220 Aug 31 00:21:00.078785 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-3966f702-ae22-4520-bb91-f53f9bf386c6 req-aa687903-7359-4a85-bcdd-b31d87e318bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044944 Aug 31 00:21:00.080641 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 153/301] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:00.183131 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.191654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c0850dcf-b1e8-40d0-8735-80b6a58e0b5c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.258979 Aug 31 00:21:00.192236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 149/302] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:20:59 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:00.252143 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:00.252981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:00.259516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.260049 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.260493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.261180 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.261623 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.262069 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.401392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:00.410206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c3ebf5a9-2be7-495c-8506-8459cc50bac9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.162796 Aug 31 00:21:00.411617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 154/303] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:00 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:00.945567 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:00.946388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:00.953071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.953561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.954108 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:00.955493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:00.956338 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:00.957085 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.065419 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:01.066208 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:01.075321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.075916 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.076414 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.077362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.077804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.078319 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.230041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.235025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.240527 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c250fc7d-9cc9-45ca-8bc7-7db6c0b43deb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.299781 Aug 31 00:21:01.252174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 150/304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:00 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:01.252174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:01.252174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:01.257291 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.259215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.260600 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.261068 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d4952661-968e-4d70-ab2c-2f4ef3c6fb35 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.200794 Aug 31 00:21:01.261182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.261501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.262011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 155/305] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:01 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:01.262305 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.262991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.263555 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.406864 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.414542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5bb79036-d42c-4fb7-a11e-5168b19f3bfd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.172312 Aug 31 00:21:01.415093 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 151/306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:01 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:01.433287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:01.433928 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:01.440885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.441372 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.441816 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.442574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:01.443024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:01.443446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:01.629440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:01.637508 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bbc9b207-d06c-497d-9271-4389ae9935aa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.208101 Aug 31 00:21:01.638248 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 156/307] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:01 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:02.262932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:02.264656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:02.271087 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.271571 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.272005 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.272689 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.273139 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.273560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.285670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:02.286569 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:02.293342 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.293939 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.294452 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.295298 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.295847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.296350 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.464484 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.468487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.475460 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.477705 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.479224 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f3bc7338-8daa-421e-854b-e349af1ba9e4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.198029 Aug 31 00:21:02.480919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-32e9b9e9-7954-4d88-80dc-eb952dda36d6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.221635 Aug 31 00:21:02.483347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 152/308] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:02 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:02.495435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 157/309] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:02 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:02.495799 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:02.496515 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:02.505757 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.506366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.506836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.507654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.508186 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.508613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.658772 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:02.659385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:02.667892 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.668434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.668874 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.669762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:02.670248 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:02.671603 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:02.756230 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.765722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-54428217-639c-4233-a735-bb217ea07001 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.280946 Aug 31 00:21:02.766327 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 153/310] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:02 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:02.845980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:02.874664 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0cf3cc21-5a7f-4751-9e78-c5e04b4cce87 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.219527 Aug 31 00:21:02.875251 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 158/311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:02 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:03.503843 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:03.504482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:03.504839 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:03.505162 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:03.511231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.511974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.512189 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.512725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.512987 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.513563 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.513764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.514249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.514519 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.514673 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.515293 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.515815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.680988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:03.690479 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:03.691945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:03.693419 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-27a368f8-2bcb-4045-9dd1-fb20752f4621 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.193406 Aug 31 00:21:03.698255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:03.704263 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-54a1626c-750a-4484-bf57-ff6a9a8224aa tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.204087 Aug 31 00:21:03.705334 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 159/312] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:03 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:03.708346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 154/313] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:03 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:03.787926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:03.789154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:03.803702 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.804208 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.804649 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.805359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.805814 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.806267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.896989 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:03.897763 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:03.906141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.906636 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.908363 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:03.909667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:03.910544 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:03.912031 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.012372 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.025888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-35d8d829-d605-4006-a7ea-70ad03341cb1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.241775 Aug 31 00:21:04.027143 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 160/314] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:03 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:04.168889 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.176780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ce9a7fd1-ee3e-4f09-a1b6-596098646c01 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.284864 Aug 31 00:21:04.177553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 155/315] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:03 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:04.717072 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:04.717691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:04.727238 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:04.727886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:04.734383 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.734794 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.735223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.735959 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.736406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.736821 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.742100 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.742684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.743178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.744116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:04.744576 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:04.745006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:04.934707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.947048 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.948502 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:04.949911 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7f262bde-ab12-47d8-965d-aa7fe78eea5a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.237226 Aug 31 00:21:04.950471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 161/316] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:04 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:04.998851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.006966 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-625eb8f8-505b-4f7e-8389-c68e7a412d97 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.285053 Aug 31 00:21:05.007524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 156/317] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:04 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:05.049087 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:05.049688 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:05.055791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.056443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.057033 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.057941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.058540 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.059114 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.197492 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:05.198917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:05.215286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.219368 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.220362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.221267 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.221973 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.222501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.222746 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.237780 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5c1a2727-791f-494a-b6ec-63ceaab0480e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.193187 Aug 31 00:21:05.238416 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 162/318] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:05 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:05.371355 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-04409a39-1cfc-45cb-aee9-48d4085b27e5 req-7c48354f-4f00-4616-b874-34a8b7a01f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcf0da7-a91d-495a-a34e-88095698fb1a", "name": "network-vif-plugged", "status": "completed", "tag": "fa6d8697-5c97-4a6e-a066-a4a09dee4e61"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:05.396163 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-04409a39-1cfc-45cb-aee9-48d4085b27e5 req-7c48354f-4f00-4616-b874-34a8b7a01f8d service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.397041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-04409a39-1cfc-45cb-aee9-48d4085b27e5 req-7c48354f-4f00-4616-b874-34a8b7a01f8d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.400484 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-04409a39-1cfc-45cb-aee9-48d4085b27e5 req-7c48354f-4f00-4616-b874-34a8b7a01f8d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.423954 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-04409a39-1cfc-45cb-aee9-48d4085b27e5 req-7c48354f-4f00-4616-b874-34a8b7a01f8d service nova] Creating event network-vif-plugged:fa6d8697-5c97-4a6e-a066-a4a09dee4e61 for instance 8dcf0da7-a91d-495a-a34e-88095698fb1a on hv-cinder-85220 Aug 31 00:21:05.431347 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-04409a39-1cfc-45cb-aee9-48d4085b27e5 req-7c48354f-4f00-4616-b874-34a8b7a01f8d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063799 Aug 31 00:21:05.432314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 163/319] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:05.462724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:05.491906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1a75896d-83ef-4918-be48-5cf2d0953c2a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.299139 Aug 31 00:21:05.492499 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 157/320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:05 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:05.981202 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:05.982046 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:05.991526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.992024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.992555 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:05.993175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:05.993635 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:05.994089 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.028597 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.029474 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.035506 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.035990 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.036423 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.037115 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.037563 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.038018 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.206153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.214550 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1b0014c0-bea7-4926-85d0-01be28fe5322 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.190279 Aug 31 00:21:06.215573 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 158/321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:06.265039 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.265728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.271959 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.272534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.273024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.273786 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.274361 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.274846 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.425046 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.433416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f98280ee-f73a-4e8b-9489-9e65085ffd57 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.177725 Aug 31 00:21:06.438195 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 159/322] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:06.513632 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:06.514277 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:06.525828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.526346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.526788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.527486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:06.527934 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:06.528360 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:06.568972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.578551 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.580081 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.581312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3c4bc0d4-246a-414b-8715-1a2d595560ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.612035 Aug 31 00:21:06.581878 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 164/323] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:05 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:06.774284 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:06.790665 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2daf32cc-7496-4245-ba7e-3e665a49fa1c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.280709 Aug 31 00:21:06.792562 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 160/324] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:06 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:07.238286 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:07.239995 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:07.248076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.248855 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.249440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.251417 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.251944 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.252373 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.448720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.459351 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a78ce104-32d2-4379-94b6-c8d8c23fed70 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.227263 Aug 31 00:21:07.459951 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 165/325] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:07 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:07.465116 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:07.466069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:07.487142 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.489961 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.497359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.498378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.499047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.499657 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.606437 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:07.607129 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:07.613982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.615009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.615752 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.616615 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.617294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.617875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.660889 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.669374 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-895e81fd-bd39-406f-9b76-ec385b365922 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.216828 Aug 31 00:21:07.670167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 161/326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:07 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:07.765008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.773468 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.775195 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.776367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-10f5a0dc-0e11-47b1-a539-e4e1ff16edbf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.175672 Aug 31 00:21:07.777042 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 166/327] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:07 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:07.812332 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:07.812942 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:07.823547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.825078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.825693 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.826598 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:07.827047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:07.828064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:07.970702 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:07.978968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c06cef73-eec7-40be-961d-53609ce846ef tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1357 microversion: 2.1 time: 0.170374 Aug 31 00:21:07.979547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 162/328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:07 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:08.300959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-76edf021-7a27-459a-9ab4-f8d2ad3b9628 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:08.301562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-76edf021-7a27-459a-9ab4-f8d2ad3b9628 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:08.307570 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76edf021-7a27-459a-9ab4-f8d2ad3b9628 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.308047 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76edf021-7a27-459a-9ab4-f8d2ad3b9628 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.308475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76edf021-7a27-459a-9ab4-f8d2ad3b9628 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.309152 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76edf021-7a27-459a-9ab4-f8d2ad3b9628 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.309763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76edf021-7a27-459a-9ab4-f8d2ad3b9628 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.310211 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76edf021-7a27-459a-9ab4-f8d2ad3b9628 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.334745 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-76edf021-7a27-459a-9ab4-f8d2ad3b9628 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/ips" status: 200 len: 145 microversion: 2.1 time: 0.038432 Aug 31 00:21:08.335335 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 167/329] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:21:08 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:08.481455 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:08.482127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:08.490641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.491115 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.491540 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.492227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.492684 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.493098 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.498800 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:08.635815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:08.647604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ece66d0a-1e7c-4069-8b05-18deae96d734 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.169881 Aug 31 00:21:08.648464 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 163/330] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:08 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:08.691433 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:08.692172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:08.699733 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.700659 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.701982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.702847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.703714 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.704984 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.801566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:08.802277 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:08.808369 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.808944 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.809645 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.810349 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:08.810869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:08.811412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:08.869814 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:08.878902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f1ae27c8-7773-40eb-a3fa-1e891daf6335 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.191565 Aug 31 00:21:08.879687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 168/331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:08 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:08.968414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:08.977564 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:08.979035 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:08.980336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9e40f8a3-9804-40c8-8ac9-13ccf849a0ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.184393 Aug 31 00:21:08.980895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 164/332] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:08 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:09.003484 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.004084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.009940 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.010422 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.010854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.011536 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.011980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.012396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.147233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.160197 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f20a6c22-0b06-4ad7-9c5f-96204edf3ecc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1546 microversion: 2.1 time: 0.160929 Aug 31 00:21:09.160897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 169/333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:08 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:09.181338 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.182023 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.188044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.189091 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.189524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.190251 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.190701 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.191123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.327911 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.339728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0a906631-990b-4753-927d-7828b368201b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1546 microversion: 2.1 time: 0.162206 Aug 31 00:21:09.340308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 165/334] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:09.360867 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.365816 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.366635 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Searching by: {'deleted': False, 'project_id': '96ac355089a14695a3e062290443283e'} {{(pid=132201) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 00:21:09.373710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.374235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.374671 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.375400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.376512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.376946 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.452147 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:09.473167 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.multi_cell_list [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132201) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 00:21:09.568337 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f4af51b9-d044-45f1-a193-e6c7c6d41f81 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211792 Aug 31 00:21:09.568929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 170/335] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:09.580290 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.580903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.586799 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.587278 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.587714 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.588401 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.588857 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.589287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.669398 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.670300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.679256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.679753 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.680327 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.681042 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.681500 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.681964 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.734581 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.743976 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e540a45a-541e-4ba7-b78d-5092ebd7f538 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1546 microversion: 2.1 time: 0.166585 Aug 31 00:21:09.757701 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 166/336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1546 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:09.826941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:09.840193 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-db2391c4-5bd1-4731-9b90-a41011817dc1 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.174870 Aug 31 00:21:09.840949 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 171/337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:09.901149 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:09.901875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:09.909582 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.910317 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.910750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:09.911449 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:09.912019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:09.912652 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.014567 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:10.015299 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:10.026596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.027467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.028581 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.030098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.031052 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.031547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.068089 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.079408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-dac54970-0960-4e48-908b-3372199528ba tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.181421 Aug 31 00:21:10.079667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 167/338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:09 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:10.218218 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.227192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.228622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:10.229766 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0321b12b-c479-4283-8f46-f4f6fb610b13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.222696 Aug 31 00:21:10.230341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 172/339] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:10 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:10.861539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:10.862186 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:10.868328 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.868812 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.869245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.869966 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:10.870421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:10.870840 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:10.999385 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.007446 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-646bd9c3-21ff-434a-8e4e-62929679d41f tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.149712 Aug 31 00:21:11.008003 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 168/340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:10 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:11.100243 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:11.100784 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:11.107282 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.107760 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.108198 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.108886 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.109339 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.109765 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.248795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.255633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:11.256697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:11.259238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4e39331c-f732-4102-9293-7147e4d91b14 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.162833 Aug 31 00:21:11.260023 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 173/341] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:11 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:11.273359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.273359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.273359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.273689 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:11.274398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:11.274838 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:11.408378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.417466 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.419007 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:11.420291 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6b89c6fa-8384-4b96-8f86-85d905e7dab9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.172016 Aug 31 00:21:11.421044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 169/342] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:11 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:12.029008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:12.029627 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:12.036410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.036894 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.037340 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.038059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.038513 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.038938 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.168353 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.176143 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b0b9060a-a8fe-4e6d-95f0-11d0464bb478 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.151007 Aug 31 00:21:12.176705 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 174/343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:12 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:12.280452 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:12.281063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:12.287754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.288237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.288671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.289363 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.289819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.290278 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.427247 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.434940 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-80220e4a-13bf-4cc8-bf0d-b56f5b7bde33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.158366 Aug 31 00:21:12.435500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 170/344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:12 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:12.444369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:12.444968 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:12.450842 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.451314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.451742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.452423 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:12.452865 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:12.453279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:12.589634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.597818 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.599269 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:12.600409 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c0724b4a-4c28-43b2-9f9e-2ff14b7f34f3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.159883 Aug 31 00:21:12.600953 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 175/345] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:12 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:13.196854 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.197487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.203551 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.204029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.204459 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.205142 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.205593 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.206044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.223868 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-024d032c-aa55-4a64-8933-00714659af34 req-f88fc795-f318-42eb-b0a4-ebca3d778397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2ac443-640c-4200-b515-84ee80e2ef9b", "name": "network-vif-plugged", "status": "completed", "tag": "77f81145-8f7a-4f02-886d-93eaf00ce9b6"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:13.234384 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-024d032c-aa55-4a64-8933-00714659af34 req-f88fc795-f318-42eb-b0a4-ebca3d778397 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.234987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-024d032c-aa55-4a64-8933-00714659af34 req-f88fc795-f318-42eb-b0a4-ebca3d778397 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.236083 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-024d032c-aa55-4a64-8933-00714659af34 req-f88fc795-f318-42eb-b0a4-ebca3d778397 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.266876 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-024d032c-aa55-4a64-8933-00714659af34 req-f88fc795-f318-42eb-b0a4-ebca3d778397 service nova] Creating event network-vif-plugged:77f81145-8f7a-4f02-886d-93eaf00ce9b6 for instance ad2ac443-640c-4200-b515-84ee80e2ef9b on hv-cinder-85220 Aug 31 00:21:13.272167 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-024d032c-aa55-4a64-8933-00714659af34 req-f88fc795-f318-42eb-b0a4-ebca3d778397 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052642 Aug 31 00:21:13.272773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 176/346] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:21:13.343185 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.351728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e444d165-4212-4456-b6b5-36deb7eeecca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.158705 Aug 31 00:21:13.352308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 171/347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:13.455983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.456598 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.462950 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.463439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.463879 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.464575 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.465029 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.465456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.599155 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.606960 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b20726f7-c669-47ff-ba43-7162542cc9a8 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.155484 Aug 31 00:21:13.607539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 177/348] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:13.622491 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:13.623099 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:13.629176 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.629659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.630167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.630906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:13.631362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:13.631789 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:13.761419 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.770412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.771863 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:13.773015 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b9eb3e1b-652a-4996-abf3-c8d2a15cc596 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.154468 Aug 31 00:21:13.773577 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 172/349] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:13 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:14.372436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:14.373070 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:14.380253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.380735 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.381168 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.381866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.382339 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.382763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.516710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:14.524453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ef6a79c3-9fdf-4d95-b9b1-2ef29b03a863 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.155861 Aug 31 00:21:14.525018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 178/350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:14 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:14.566117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1726b1c5-937c-4e26-b2ac-688a4c9e52a2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6305d7dc-fcd2-4a82-98a6-dfac5a924cf2"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:14.568557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1726b1c5-937c-4e26-b2ac-688a4c9e52a2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:14.574613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1726b1c5-937c-4e26-b2ac-688a4c9e52a2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.575084 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1726b1c5-937c-4e26-b2ac-688a4c9e52a2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.575508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1726b1c5-937c-4e26-b2ac-688a4c9e52a2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.576358 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1726b1c5-937c-4e26-b2ac-688a4c9e52a2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.576803 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1726b1c5-937c-4e26-b2ac-688a4c9e52a2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.577218 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1726b1c5-937c-4e26-b2ac-688a4c9e52a2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.628416 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:14.629108 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:14.635334 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.635896 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.636409 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.637191 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.637722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.638272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.764096 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:14.771759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-90188b39-6615-4239-b793-738ed9f0a32a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.147930 Aug 31 00:21:14.772327 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 179/351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:14 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:14.777004 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-89f1ed94-d65e-4d3e-b467-96ecc4ba4759 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61cad0b4-710c-47a3-9489-bac1345b455c"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:14.779313 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-89f1ed94-d65e-4d3e-b467-96ecc4ba4759 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:14.785394 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89f1ed94-d65e-4d3e-b467-96ecc4ba4759 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.785895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89f1ed94-d65e-4d3e-b467-96ecc4ba4759 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.786337 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89f1ed94-d65e-4d3e-b467-96ecc4ba4759 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:14.787019 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89f1ed94-d65e-4d3e-b467-96ecc4ba4759 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:14.787471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89f1ed94-d65e-4d3e-b467-96ecc4ba4759 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:14.787895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89f1ed94-d65e-4d3e-b467-96ecc4ba4759 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.465228 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1726b1c5-937c-4e26-b2ac-688a4c9e52a2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "POST /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.903466 Aug 31 00:21:18.470959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-89f1ed94-d65e-4d3e-b467-96ecc4ba4759 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.697325 Aug 31 00:21:18.471568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 180/352] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:21:14 2022] POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/os-volume_attachments => generated 194 bytes in 3699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:18.476131 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 173/353] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:21:14 2022] POST /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments => generated 194 bytes in 3913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:18.476750 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:18.478530 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:18.489564 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.490184 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.490914 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.491039 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:18.491728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:18.492480 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.493217 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.494078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.501766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.502567 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.503179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.504107 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.504758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.505395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.642172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.651778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.653344 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.654539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-01804ffe-8c5c-4e2d-936c-aa03fd8c72fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.181907 Aug 31 00:21:18.655133 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.655273 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 181/354] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:18 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:18.659602 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:18.660441 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:18.663868 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-83f21e60-cc21-4e12-829d-7d69d4f74a03 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.188735 Aug 31 00:21:18.664743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 174/355] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:18 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:18.667037 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.667762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.668394 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.669275 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:18.669934 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:18.670539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:18.802699 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:18.811191 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e05edc34-1fd8-4472-9dce-1955e74e9b9e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.154996 Aug 31 00:21:18.811758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 182/356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:18 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:19.681257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:19.681876 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:19.684233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:19.684838 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:19.687782 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:19.689356 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.689836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.690470 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.691099 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.691721 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.692147 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.694145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.694663 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.695049 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.695750 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.697479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.697479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.824607 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.828329 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.834405 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.835885 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:19.836640 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0dae8e33-1f40-4edc-9612-9c35ce011b73 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1507 microversion: 2.1 time: 0.156212 Aug 31 00:21:19.837041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-126a0795-1816-431c-b09f-320d11ccfd55 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.159889 Aug 31 00:21:19.837214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 183/357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:19 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:19.841629 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:19.842269 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:19.848481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.848961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.849393 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.850093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:19.850545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:19.850705 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 175/358] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:19 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:19.850963 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:19.999069 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:20.008407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-479dc9f4-b02c-401a-bd55-eb1897c1438c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.170209 Aug 31 00:21:20.010092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 184/359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:19 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:20.876329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:20.876905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:20.883432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.883919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.884353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:20.885052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:20.885503 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:20.885952 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.015770 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.023807 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.025479 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.026676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6aeb5dd5-59be-4787-9434-45eab68c14c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.154479 Aug 31 00:21:21.027220 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 176/360] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:20 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:21.030076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:21.030715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:21.037680 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.038307 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.038746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.039429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:21.039880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:21.040301 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:21.166578 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:21.169959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:21.175406 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b3983450-e5a3-4429-ab76-980243e9b0c7 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.149504 Aug 31 00:21:21.175965 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 185/361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:21 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:22.050991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:22.051600 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:22.058311 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.058911 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.059222 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.059909 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.060360 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.060787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.194730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.196423 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:22.197032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:22.203609 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.204629 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.205156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.205402 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.205584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.206505 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:22.206623 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4d4d96ee-a212-4ced-b6cd-cef1e5a0d189 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.160418 Aug 31 00:21:22.206954 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:22.207425 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 177/362] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:22 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:22.207543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:22.342525 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:22.350591 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f576f8d2-5dc0-41a2-9fc5-ecc7570e2564 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.158012 Aug 31 00:21:22.351158 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 186/363] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:22 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:23.237071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:23.237754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:23.244420 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.244986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.245417 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.246329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.247167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.247274 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.266096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:23.370841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:23.372310 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:23.379590 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.380377 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.380936 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.381880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:23.382524 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:23.383172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:23.412170 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.423492 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.436234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.437592 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9e514ed7-4119-451b-823e-f8f8e10865d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.204356 Aug 31 00:21:23.438685 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 178/364] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:23 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:23.525307 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:23.533040 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e81dfb9a-5cfc-4566-b32d-8b7291c1e574 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.166443 Aug 31 00:21:23.534513 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 187/365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:23 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:24.461045 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:24.461765 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:24.468094 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.468580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.469017 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.469718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.470198 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.471218 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.555568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:24.556946 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:24.562201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=90 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:24.568181 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.569245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.570552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.571681 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:24.572624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:24.576569 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:24.625729 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:24.636894 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:24.638974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:24.640227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f9a77491-6ca0-42c7-99dc-afd35823bc7e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1743 microversion: 2.20 time: 0.183499 Aug 31 00:21:24.641077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 179/366] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:24 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:24.716244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:24.724106 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a58f0118-3243-4f9a-be8d-449c73dd18d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.173536 Aug 31 00:21:24.724766 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 188/367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:24 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:25.665298 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:25.665977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:25.673047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.673535 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.674001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.674708 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.675166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.675591 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.745956 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:25.746780 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:25.753387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.753891 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.754333 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.755027 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:25.755478 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:25.755902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:25.812653 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.820940 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.822480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.823646 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c4dd999d-3019-4915-a232-6c1e2b5a7921 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1743 microversion: 2.20 time: 0.162348 Aug 31 00:21:25.824209 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 180/368] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:25 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:25.914830 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:25.922928 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-fb8a0a3f-87c4-4301-af6c-b415b5965832 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.181289 Aug 31 00:21:25.923518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 189/369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:25 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:26.098078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6a9f6ff3-5921-41c1-bbf0-50a681806c3e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:26.104416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a9f6ff3-5921-41c1-bbf0-50a681806c3e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.104896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a9f6ff3-5921-41c1-bbf0-50a681806c3e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.105683 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a9f6ff3-5921-41c1-bbf0-50a681806c3e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.175786 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6a9f6ff3-5921-41c1-bbf0-50a681806c3e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Going to try to stop instance {{(pid=132200) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 00:21:26.222313 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6a9f6ff3-5921-41c1-bbf0-50a681806c3e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/action" status: 202 len: 0 microversion: 2.1 time: 0.127916 Aug 31 00:21:26.222902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 181/370] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:21:26 2022] POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:21:26.233894 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:26.234505 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:26.240638 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.241217 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.241546 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.242352 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.242800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.243215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.378764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.387103 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a3b3ec70-23ac-4a0c-bfce-e35e3803dcb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.157037 Aug 31 00:21:26.387669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 190/371] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:26 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:26.849948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:26.850574 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:26.857142 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.857624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.858103 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.858793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.859247 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.859671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.943952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:26.944559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:26.951136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.951618 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.952060 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.952758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:26.953278 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:26.953711 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:26.988408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.996735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.998225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:26.999382 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d15d0cfc-0abc-4f2f-9f7f-e92c8b1d8556 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1743 microversion: 2.20 time: 0.154315 Aug 31 00:21:26.999960 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 182/372] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:26 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:27.082855 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:27.090674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-758679cd-6126-4b39-80e4-37db879d3691 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.150558 Aug 31 00:21:27.091244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 191/373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:26 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:27.407681 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:27.408215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:27.410228 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=76 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:27.415780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.416263 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.416698 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.417381 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:27.417830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:27.418317 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:27.544410 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:27.553401 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a3c5fe21-b73e-4d96-9fb7-4d15f209f496 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.149642 Aug 31 00:21:27.553992 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 183/374] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:27 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:28.022630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:28.023239 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:28.029634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.030224 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.030666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.031354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.031806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.032232 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.113636 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:28.114372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:28.120925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.121404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.121860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.122547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.123068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.123487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.164394 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:28.172878 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:28.174354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:28.175511 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8aede313-22dc-4035-b5eb-1181d3a46645 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1743 microversion: 2.20 time: 0.156832 Aug 31 00:21:28.176069 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 192/375] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:28 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:28.255480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:28.263135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-272002eb-19bb-49e5-91a6-ace60bd9f586 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.153374 Aug 31 00:21:28.263691 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 184/376] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:28 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:28.574016 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:28.574631 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:28.580669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.581154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.581594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.582322 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:28.582777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:28.583205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:28.711542 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:28.719988 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3548cca4-5468-4730-a172-facb332b0d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.149939 Aug 31 00:21:28.720637 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 193/377] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:28 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:29.199060 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:29.199668 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:29.206316 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.206805 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.207244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.207971 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.208428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.208850 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.281316 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-58cf4c8d-a2f7-451b-b598-8523dbefcf8f req-fb4c3863-9e14-4547-b6c2-dd38f528ab3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28862807-4ab6-4376-9e01-b40cd4e4483a", "name": "network-vif-plugged", "status": "completed", "tag": "07e1f3ff-ed06-4bbc-af49-616e3dd80848"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:29.293169 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-58cf4c8d-a2f7-451b-b598-8523dbefcf8f req-fb4c3863-9e14-4547-b6c2-dd38f528ab3b service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.293829 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-58cf4c8d-a2f7-451b-b598-8523dbefcf8f req-fb4c3863-9e14-4547-b6c2-dd38f528ab3b service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.294272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-58cf4c8d-a2f7-451b-b598-8523dbefcf8f req-fb4c3863-9e14-4547-b6c2-dd38f528ab3b service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.310403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-58cf4c8d-a2f7-451b-b598-8523dbefcf8f req-fb4c3863-9e14-4547-b6c2-dd38f528ab3b service nova] Creating event network-vif-plugged:07e1f3ff-ed06-4bbc-af49-616e3dd80848 for instance 28862807-4ab6-4376-9e01-b40cd4e4483a on hv-cinder-85220 Aug 31 00:21:29.312793 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-58cf4c8d-a2f7-451b-b598-8523dbefcf8f req-fb4c3863-9e14-4547-b6c2-dd38f528ab3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039696 Aug 31 00:21:29.313982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 194/378] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:29.319186 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:29.319869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:29.326048 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.326533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.326963 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.327649 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.328236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.328655 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.367510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.375895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.377436 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.378607 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b9e08a9e-c65a-4308-9b72-1079a9f1f580 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1743 microversion: 2.20 time: 0.183419 Aug 31 00:21:29.379166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 185/379] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:29 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:29.467790 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.476284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-31cdeecb-f7a3-4f95-9c82-5232f817049d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.161057 Aug 31 00:21:29.476846 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 195/380] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:29 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:29.740467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:29.741069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:29.746868 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.747340 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.747766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.748441 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:29.748884 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:29.749307 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:29.896534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:29.906695 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-98a13c18-b37f-47f0-8307-cf21d5f1c3b0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.169912 Aug 31 00:21:29.907545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 186/381] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:29 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:30.401541 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:30.402191 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:30.408791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.409312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.409752 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.410475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.410927 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.411349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.496818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:30.497576 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:30.504861 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.505575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.506136 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.507036 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.507568 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.508029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.547418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.556390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.557831 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.559133 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c6e5aaa3-fd63-46d4-807c-dcc8b3c7fa22 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1743 microversion: 2.20 time: 0.161455 Aug 31 00:21:30.559687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 196/382] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:30 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:30.651442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:30.660160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4991a515-bb59-4cfb-a818-f119446854ad tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.167203 Aug 31 00:21:30.660757 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 187/383] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:30 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:30.930450 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:30.931050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:30.936933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.937405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.937831 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:30.938530 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:30.938974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:30.939394 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.071818 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.080016 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5ca2b4c8-cb1b-4043-81f5-e995caf24c4b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.153361 Aug 31 00:21:31.080520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 197/384] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:30 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:31.581173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:31.581777 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:31.588207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.588687 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.589124 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.589803 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.590282 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.590717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.681875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:31.682544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:31.688894 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.689369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.689794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.691132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:31.691573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:31.692015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:31.719669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.730542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.732000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.733177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5be5d305-6fa9-470d-99ea-cfbf9d30e53d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1743 microversion: 2.20 time: 0.156238 Aug 31 00:21:31.733738 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 188/385] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:31 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:31.822774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:31.830594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-be5b5b46-d396-493a-9747-39d66f012144 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.152438 Aug 31 00:21:31.831163 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 198/386] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:31 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:32.103280 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:32.103888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:32.109969 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.110454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.110918 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.111610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.112737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.113194 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.243351 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.251897 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6b499277-5e79-4403-98d7-f38c2044705c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.152501 Aug 31 00:21:32.252469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 189/387] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:32 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:32.757716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:32.758354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:32.764999 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.765482 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.765956 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.766647 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.767137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.767567 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.851159 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:32.851766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:32.858566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.859302 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.860663 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.861252 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:32.861701 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:32.862145 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:32.902038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.910634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.912179 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.913349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6503e552-eeb1-4e75-b28a-ab1fec8a522e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1743 microversion: 2.20 time: 0.159598 Aug 31 00:21:32.913984 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 199/388] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:32 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:32.991930 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:32.999677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-eb5356f3-7fed-4106-8d38-cfd660a1781d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.152311 Aug 31 00:21:33.000244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 190/389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:32 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:33.272494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:33.273101 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:33.279749 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.280231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.280667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.281351 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.281801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.282321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.416674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:33.425718 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9685401d-15c5-4525-a6fd-7204f8a87267 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.157045 Aug 31 00:21:33.426300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 200/390] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:33 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:33.935906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:33.937210 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:33.943795 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.944275 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.944926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:33.945604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:33.946086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:33.946697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.021544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.022337 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.029279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.029802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.030288 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.031186 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.031647 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.032082 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.088223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.096876 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.098900 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.100059 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9aaeb2f6-edcd-46f2-8f3c-296503d7c956 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1743 microversion: 2.20 time: 0.168216 Aug 31 00:21:34.100609 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 191/391] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:33 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:34.167035 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.175093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-817dce03-c947-4df3-8c0b-5161622be160 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1502 microversion: 2.1 time: 0.158460 Aug 31 00:21:34.175696 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 201/392] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:34.196732 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f88bdefe-2925-4252-bbb9-0f89242cb99a"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:34.199244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.205547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.206117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.207115 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.207879 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.208332 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.208749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.233325 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] HTTP exception thrown: Cannot 'attach_volume' instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a while it is in vm_state rescued Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Request method failure captured: Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: POST /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a/os-volume_attachments HTTP/1.1 Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 74 Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj1A1kG2LdTorCDgkkVutZAVVGIaO4-7cOAUPDdewrt9JNvRFxPRTVO1_BKlI-5brYoD4Aac_PF8C4vrfca77Oa_HK8LAwmhL5pfRxTAmp-Z5nlkUqMCh13xrTQokK16igBIB5IBYPzSV0HilEnWbVpSU-HBpCeo0mcAS6-BzyFzOs Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:21:34.235271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: c924dfe7e9c941f9b7110c1a440633dc Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {"volumeAttachment": {"volumeId": "f88bdefe-2925-4252-bbb9-0f89242cb99a"}} Aug 31 00:21:34.236977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Cannot 'attach_volume' instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a while it is in vm_state rescued Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'server_id': '6b85b900-da07-4c75-b7f3-4d0681c11d3a', 'body': {'volumeAttachment': {'volumeId': 'f88bdefe-2925-4252-bbb9-0f89242cb99a'}}} Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:21:34.238347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a while it is in vm_state rescued Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:21:34.239988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:21:34.241498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:21:34.241498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:21:34.241498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a while it is in vm_state rescued Aug 31 00:21:34.241498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:21:34.241498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Returning 409 to user: Cannot 'attach_volume' instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a while it is in vm_state rescued {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:21:34.241498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2e89431a-9955-4c3b-bc0d-6af5b228e626 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043938 Aug 31 00:21:34.241498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 192/393] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:21:34 2022] POST /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:21:34.247281 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-03cb2873-8f7f-4d59-bf85-5fafac5e1a60 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:34.248172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-03cb2873-8f7f-4d59-bf85-5fafac5e1a60 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.261283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03cb2873-8f7f-4d59-bf85-5fafac5e1a60 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.261778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03cb2873-8f7f-4d59-bf85-5fafac5e1a60 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.262255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03cb2873-8f7f-4d59-bf85-5fafac5e1a60 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.262979 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03cb2873-8f7f-4d59-bf85-5fafac5e1a60 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.263929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03cb2873-8f7f-4d59-bf85-5fafac5e1a60 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.264474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-03cb2873-8f7f-4d59-bf85-5fafac5e1a60 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.309329 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:34.346247 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-03cb2873-8f7f-4d59-bf85-5fafac5e1a60 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a/action" status: 202 len: 0 microversion: 2.1 time: 0.102911 Aug 31 00:21:34.347254 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 202/394] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:21:34 2022] POST /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:21:34.355117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.355723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.363066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.363561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.364076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.364992 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.365738 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.366203 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.457750 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:34.462755 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:34.471396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.471883 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.472797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.473660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:34.474945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:34.475780 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:34.561984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.571606 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c2c53138-bcee-4be9-a1cc-dc64049b001c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1510 microversion: 2.1 time: 0.220103 Aug 31 00:21:34.574578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 193/395] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:34.700302 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:34.709164 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-48caf8f2-c2b5-4ab8-9471-549048a2f054 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.264835 Aug 31 00:21:34.727407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 203/396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:34 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:35.124977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:35.126456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:35.143153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.144512 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.145676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.146616 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.149557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.150294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.176688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:35.590835 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.602606 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.604058 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.605076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:35.606550 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:35.606971 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-111713d1-2711-403a-a74c-c2ea82970e13 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.486140 Aug 31 00:21:35.607483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 194/397] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:35 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:35.626136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.628105 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.629492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.630467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.631652 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.632291 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.744611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:35.748730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:35.774497 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.775695 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.776430 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.777520 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:35.778303 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:35.782091 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:35.930763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:35.939189 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d60bfd71-acdf-4f4a-a953-716e70c1bdc9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1510 microversion: 2.1 time: 0.342057 Aug 31 00:21:35.942737 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 204/398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:35 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1510 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:36.112782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:36.123757 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-32d348ef-a6c5-449d-8ae3-20804b8e36af tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.389102 Aug 31 00:21:36.124958 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 195/399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:35 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:36.633178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:36.633935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:36.645335 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.645945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.646405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.648256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.648735 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.649167 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.801562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:36.811725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:36.813521 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:36.815277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bf243726-3f8a-4439-b28c-180d9f42cb71 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.186782 Aug 31 00:21:36.816920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 205/400] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:36 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:36.972626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:36.973208 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:36.988158 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.988651 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.990001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:36.990724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:36.991186 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:36.991619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.146566 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:37.147114 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:37.156538 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.158238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.158755 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.163637 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.164362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.164818 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.202091 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.210882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-75b44e51-a371-4d97-a008-b4eb2192fec9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1510 microversion: 2.1 time: 0.241947 Aug 31 00:21:37.223019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 196/401] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:36 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:37.442232 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:37.451173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-19cdb69f-d221-42c3-bf49-f4aec65a162e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.308787 Aug 31 00:21:37.451785 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 206/402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:37 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:37.840208 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:37.840832 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:37.855934 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.856489 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.856952 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:37.857942 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:37.858552 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:37.859135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.173163 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.182680 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.187589 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.193025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b19a9330-401d-4d97-9d82-5e8850fc6ead tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.356802 Aug 31 00:21:38.193946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 197/403] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:37 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:38.234101 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:38.235710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:38.245909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.248297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.249418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.251002 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.251790 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.252443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.473308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:38.474324 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:38.485453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.486262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.487851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.490636 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:38.491357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:38.492391 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:38.532078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:38.541505 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-14cc6ace-fd3d-44a0-8917-114f298c01ee tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1510 microversion: 2.1 time: 0.311578 Aug 31 00:21:38.542735 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 207/404] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:38 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:39.118685 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.132778 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-58efb51c-4912-4d6b-8e1a-317f1041d510 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.663315 Aug 31 00:21:39.133763 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 198/405] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:38 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:39.221467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:39.222149 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:39.228981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.229507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.229975 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.230666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.231242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.231669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.438117 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.453038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.455006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.458479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3dc17259-467b-4e89-9a5c-3e2d8cae6248 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.241141 Aug 31 00:21:39.459082 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 208/406] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:39 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:39.565007 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:39.565813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:39.578596 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.579089 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.579713 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.580583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:39.581498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:39.587855 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:39.877408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:39.887388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e2769f1b-2c1b-4a9f-9f18-7d51d8c52dc4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1510 microversion: 2.1 time: 0.327333 Aug 31 00:21:39.891598 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 199/407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:39 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:40.160768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.161642 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.173790 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.179432 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.180546 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.181597 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.182563 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.183648 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.486341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.487304 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.490568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.499943 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7f20aa67-b3dc-4a5d-b6a1-7b7de86b217f tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.347273 Aug 31 00:21:40.502211 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 209/408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:40.520931 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.521626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.522253 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.523107 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.523710 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.524346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.617460 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.618815 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.626927 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.627666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.628349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.629289 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.630006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.630655 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.856301 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:40.890390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5a7f2270-12fe-4645-90e8-584209231d09 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1592 microversion: 2.1 time: 0.279615 Aug 31 00:21:40.908594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 210/409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1592 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:40.935009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:40.937168 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:40.954160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.954653 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.955086 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:40.955786 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:40.956811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:40.962588 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.188145 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:41.206326 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:41.208121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:41.209542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4ca8b955-37a7-4767-a8bb-6d69800ee829 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.730934 Aug 31 00:21:41.222688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 200/410] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:41.222843 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:41.241180 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6771a802-6ab8-448d-90c5-cca4dbc46a42 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1516 microversion: 2.1 time: 0.322968 Aug 31 00:21:41.242263 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 211/411] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:40 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1516 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:41.526235 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:41.526860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:41.551228 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.551726 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.552188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:41.552898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:41.553359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:41.553781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.236995 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:42.238139 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:42.250760 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.255101 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.255677 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.257080 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:42.263524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.267999 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:42.275124 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2c33f07f-df48-4d91-962a-7a1ff33d6b62 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.752895 Aug 31 00:21:42.276530 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:42.283735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 201/412] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:41 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:42.593262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.607327 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.608784 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:42.613325 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6f754b43-fdf5-442d-b9d0-81b674b6a869 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.379860 Aug 31 00:21:42.630865 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 212/413] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:42 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:43.057387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e8e7cd85-3a63-4eae-936e-6dcd5e95d369 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'create', calling method: .version_select at 0x7fcd6bdf1700>, body: {"keypair": {"name": "tempest-keypair-1778436930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF73TAqYvV408LJBRiDnMiGJhCjS4dI7j/0+8AtAejLhNJWs7wVWfLGVRrnkFI5jyGymm3MIGhtbnvMcfBL+8G9rdipPNeWqnfp5bUOcwxaOzaRQfwOrdoA8ZrsPg++CQ=="}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:43.113289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-e8e7cd85-3a63-4eae-936e-6dcd5e95d369 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Getting quotas for project 0043c999ad9d451ab45c19cbea1765ea. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:21:43.138032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-e8e7cd85-3a63-4eae-936e-6dcd5e95d369 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Getting quotas for user c924dfe7e9c941f9b7110c1a440633dc and project 0043c999ad9d451ab45c19cbea1765ea. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:21:43.234236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e8e7cd85-3a63-4eae-936e-6dcd5e95d369 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181446 Aug 31 00:21:43.244690 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 202/414] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:21:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:43.305014 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:43.305649 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:43.320505 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.324965 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.325415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.326178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.329074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.330902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.643258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:43.647245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:43.665215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.667115 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.669434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.674521 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:43.675234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:43.676404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:43.981544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:43.996205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e79736c7-fb57-42f6-a48e-de716f9124c3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.695202 Aug 31 00:21:44.005064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 213/415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:43 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:44.259454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:44.283358 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:44.286366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:44.289968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a335c21f-187c-4793-b143-0edc40030cc1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.651594 Aug 31 00:21:44.293349 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 203/416] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:43 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:45.038669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:45.049188 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:45.072423 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:45.073018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:45.076839 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.077979 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:45.080021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:45.082537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.324908 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:45.327274 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:45.338925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:45.341541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:45.345236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.346657 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:45.357253 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:45.358128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:45.653489 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.662229 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.663693 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:45.664882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-71574ffb-998e-425b-b4d8-ddd76ed02d90 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.344260 Aug 31 00:21:45.665449 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 204/417] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:45 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:46.680533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:46.688608 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:46.689525 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-acf71252-404c-42d7-9529-056b862adf65 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 1.669079 Aug 31 00:21:46.692168 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 214/418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:45 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:46.703913 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:46.737152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.745597 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.746481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:46.748838 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:46.750245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:46.750917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:47.091934 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:47.113928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:47.119290 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:47.126479 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-088ec8ad-b21d-471d-8636-af1ade9f7f44 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.438655 Aug 31 00:21:47.129887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 205/419] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:46 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:21:47.133887 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-1061a7ac-8332-4baf-8340-78d9c80df959 req-7f9eb7ae-2640-42ba-97e8-c155c0341101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcf0da7-a91d-495a-a34e-88095698fb1a", "tag": "fa6d8697-5c97-4a6e-a066-a4a09dee4e61"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:47.155113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-1061a7ac-8332-4baf-8340-78d9c80df959 req-7f9eb7ae-2640-42ba-97e8-c155c0341101 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.156062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-1061a7ac-8332-4baf-8340-78d9c80df959 req-7f9eb7ae-2640-42ba-97e8-c155c0341101 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.156660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-1061a7ac-8332-4baf-8340-78d9c80df959 req-7f9eb7ae-2640-42ba-97e8-c155c0341101 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:47.200544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-1061a7ac-8332-4baf-8340-78d9c80df959 req-7f9eb7ae-2640-42ba-97e8-c155c0341101 service nova] Creating event network-changed:fa6d8697-5c97-4a6e-a066-a4a09dee4e61 for instance 8dcf0da7-a91d-495a-a34e-88095698fb1a on hv-cinder-85220 Aug 31 00:21:47.212554 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-1061a7ac-8332-4baf-8340-78d9c80df959 req-7f9eb7ae-2640-42ba-97e8-c155c0341101 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083999 Aug 31 00:21:47.214131 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 215/420] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:47.718472 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:47.719875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:47.733226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.733943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.735396 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:47.738299 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:47.743736 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:47.744687 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.155680 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:48.156547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:48.182812 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:48.188850 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:48.189450 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.192859 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:48.193349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:48.199057 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:48.442446 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.460346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b96f6d26-6e71-4587-9641-090d3d9b5410 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.746483 Aug 31 00:21:48.475517 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 206/421] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:47 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:48.493808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2044373363", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b08e6dcc-55d3-4b2c-af3f-6bba850da199"}], "security_groups": [{"name": "tempest-securitygroup--1613783033"}], "key_name": "tempest-keypair-1778436930", "user_data": "}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:48.694356 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.711418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.717958 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:48.720087 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-344ae844-cfaf-43be-bb28-d52e4b8f4e70 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.570730 Aug 31 00:21:48.738606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 216/422] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:48 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:49.391892 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.network.neutron [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] validate_networks() for [('b08e6dcc-55d3-4b2c-af3f-6bba850da199', None, None, None, None, None)] {{(pid=132200) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:21:49.493405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:49.494050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:49.527919 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.530699 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.532477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.549304 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.551831 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.553362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.823773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:49.835503 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d415876b-21e4-48e1-bc1a-11832c60c0be tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.355849 Aug 31 00:21:49.836665 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 217/423] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:49 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:49.842169 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:49.842964 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:49.849465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.850177 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.851011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:49.852063 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:49.852673 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:49.853245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.341318 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:50.356194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:50.359934 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:50.361308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-117dc9e5-9221-4f85-aaf4-26ce554714f7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.523391 Aug 31 00:21:50.366632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 218/424] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:49 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:50.771975 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Flavor limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:21:50.779211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Image limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:21:50.780090 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Flavor pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:21:50.781948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Image pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:21:50.782625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:21:50.797259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.798197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.798889 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.800031 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.801045 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.801708 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.850313 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Getting quotas for project 0043c999ad9d451ab45c19cbea1765ea. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:21:50.856214 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Getting quotas for user c924dfe7e9c941f9b7110c1a440633dc and project 0043c999ad9d451ab45c19cbea1765ea. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:21:50.856988 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:50.857958 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:50.872667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Going to run 1 instances... {{(pid=132200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:21:50.873237 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.876507 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:21:50.878567 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.879091 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.885198 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:50.886310 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:50.888503 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:50.945458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:51.030398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0fed1dc2-9f19-4577-adac-b2d95ffd2d3a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.553420 Aug 31 00:21:51.032305 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 207/425] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:21:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 2556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:21:51.060456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f9e0eb8a-141d-417d-b39f-7d2c8569eb2d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:51.063467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f9e0eb8a-141d-417d-b39f-7d2c8569eb2d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:51.198931 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f9e0eb8a-141d-417d-b39f-7d2c8569eb2d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:51.210539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f9e0eb8a-141d-417d-b39f-7d2c8569eb2d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1246 microversion: 2.1 time: 0.166307 Aug 31 00:21:51.213700 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 208/426] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:51 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1246 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:51.390238 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:51.391151 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:51.404959 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.405912 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.408160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.409268 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.412966 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.418207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.431205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:51.447039 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ba19b70c-ee4b-4de3-9f34-a78f6c654119 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1723 microversion: 2.1 time: 0.593915 Aug 31 00:21:51.462112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 219/427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:50 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1723 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:51.629181 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-48468824"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:51.629978 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:51.647205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.650698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.651688 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.658283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:51.661308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:51.662956 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:51.719734 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:51.728716 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:51.733890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:51.737662 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e0e7957b-cd9c-4042-9290-bf36e2d4b5b4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.352165 Aug 31 00:21:51.740762 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 209/428] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:51 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:52.195888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.network.security_group_api [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Adding security group 9e290543-0451-4eb0-8b0d-469b4069cc75 to port fa6d8697-5c97-4a6e-a066-a4a09dee4e61 Aug 31 00:21:52.235438 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b0e3d668-db84-47a3-bf5b-bcce0a5469ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:52.250619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b0e3d668-db84-47a3-bf5b-bcce0a5469ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:52.433705 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b0e3d668-db84-47a3-bf5b-bcce0a5469ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:52.442160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b0e3d668-db84-47a3-bf5b-bcce0a5469ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1246 microversion: 2.1 time: 0.213095 Aug 31 00:21:52.442969 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 210/429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:52 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1246 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:52.476501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:52.491723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:52.504601 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.505109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.505557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.506317 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.506779 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.507253 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.707538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:52.725300 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-43302eb0-bda0-471d-b991-a5668ae2be9a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1700 microversion: 2.1 time: 0.253003 Aug 31 00:21:52.725918 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 211/430] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:52 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1700 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:52.748860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c53321bc-d345-40b9-a0d2-e718ecf1cea0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:52.757597 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c53321bc-d345-40b9-a0d2-e718ecf1cea0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.758696 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c53321bc-d345-40b9-a0d2-e718ecf1cea0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.759213 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c53321bc-d345-40b9-a0d2-e718ecf1cea0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.817447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c53321bc-d345-40b9-a0d2-e718ecf1cea0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Going to try to start instance {{(pid=132200) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 00:21:52.965803 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c53321bc-d345-40b9-a0d2-e718ecf1cea0 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/action" status: 202 len: 0 microversion: 2.1 time: 0.221782 Aug 31 00:21:52.967269 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 212/431] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:21:52 2022] POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:21:52.973156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:52.974204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:52.983738 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.985766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.992779 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:52.995785 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:52.996546 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:52.997867 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.213395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.218639 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:53.231307 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.233433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.234958 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cc24494e-fec1-4d61-a2b1-97bba7879d93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.266323 Aug 31 00:21:53.235847 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 213/432] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:52 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:53.251160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:53.253297 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:53.261448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.262349 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.262985 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.263849 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.264516 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.265098 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.290568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-208a85d1-9a48-474e-863c-12802842d1fa tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "POST /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/action" status: 202 len: 0 microversion: 2.1 time: 1.666327 Aug 31 00:21:53.292886 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 220/433] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:21:51 2022] POST /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/action => generated 0 bytes in 1670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:21:53.320348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-679d07e4-5af0-464f-8281-99309b975ab0 req-c2c97592-6c4d-4ede-8913-e8ff63d4968c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcf0da7-a91d-495a-a34e-88095698fb1a", "tag": "fa6d8697-5c97-4a6e-a066-a4a09dee4e61"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:53.344302 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-679d07e4-5af0-464f-8281-99309b975ab0 req-c2c97592-6c4d-4ede-8913-e8ff63d4968c service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.345399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-679d07e4-5af0-464f-8281-99309b975ab0 req-c2c97592-6c4d-4ede-8913-e8ff63d4968c service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.358503 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-679d07e4-5af0-464f-8281-99309b975ab0 req-c2c97592-6c4d-4ede-8913-e8ff63d4968c service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.405897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-679d07e4-5af0-464f-8281-99309b975ab0 req-c2c97592-6c4d-4ede-8913-e8ff63d4968c service nova] Creating event network-changed:fa6d8697-5c97-4a6e-a066-a4a09dee4e61 for instance 8dcf0da7-a91d-495a-a34e-88095698fb1a on hv-cinder-85220 Aug 31 00:21:53.428090 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-679d07e4-5af0-464f-8281-99309b975ab0 req-c2c97592-6c4d-4ede-8913-e8ff63d4968c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130552 Aug 31 00:21:53.429501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 221/434] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:53.436642 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:53.437354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:53.447214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.452807 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.458988 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.460640 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.463115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.463568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.786168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:53.802945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1f7a77d5-7e16-444b-979c-4e65e11602fc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1709 microversion: 2.1 time: 0.562120 Aug 31 00:21:53.807473 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 214/435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:53 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1709 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:53.823040 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:53.825556 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:53.851151 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.854756 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.857490 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:53.863456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:53.864236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:53.866392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.404773 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:54.416049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-39a5148a-8df7-487a-b5e8-c45c16334f27 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1298 microversion: 2.1 time: 0.605115 Aug 31 00:21:54.436668 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 215/436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:53 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1298 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:54.443009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:54.443984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:54.473215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.477698 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.478299 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.479467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.480174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.480842 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.757276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:54.774256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6d8d1ec1-b3c0-4f22-998c-200ba4b05ae9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1756 microversion: 2.1 time: 1.343180 Aug 31 00:21:54.774768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 222/437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:53 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1756 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:54.826641 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:54.827257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:54.833089 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=70 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:54.835169 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.835926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.837521 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:54.838463 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:54.839112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:54.839705 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:55.022371 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:55.042262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:55.043705 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:55.044880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-72585bbe-ef34-45e5-843f-fa04801009b0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.606660 Aug 31 00:21:55.060549 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 216/438] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:54 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:55.284724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:55.294563 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-eca0fe8e-880d-4c73-9268-efe947817c6e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1709 microversion: 2.1 time: 0.471707 Aug 31 00:21:55.300107 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 223/439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:54 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1709 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:21:55.448234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:55.450197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:55.470936 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:55.474314 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:55.476192 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:55.476891 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:55.483082 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:55.484871 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:55.678344 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:55.691454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-899069a3-87bf-4e22-841e-93fc79c357c6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1304 microversion: 2.1 time: 0.251784 Aug 31 00:21:55.695023 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 217/440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:55 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1304 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:56.073929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:56.074498 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:56.085876 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.088585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.089378 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.096035 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.096895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.097555 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.334088 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:56.338512 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:56.367834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:56.371537 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.372089 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.372548 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.376448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.376979 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.380677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.542925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.568549 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.575212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.576669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1754fe36-d7ae-4639-956f-e7a02fd2bb4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.509544 Aug 31 00:21:56.577422 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 224/441] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:56 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:56.630023 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.640162 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7a44dd26-bf1f-404d-9cbb-8a0c10651adf tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1709 microversion: 2.1 time: 0.322711 Aug 31 00:21:56.640768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 218/442] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:56 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1709 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:56.718849 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:56.719701 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:56.729167 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.731716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.733346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.742904 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:56.743665 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:56.744397 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:56.986002 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:56.995080 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4e7a9f6d-cda5-4d45-96bd-70733de5bfa1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.280061 Aug 31 00:21:56.996043 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 225/443] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:56 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:57.577677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a859fafb-d306-47e6-8ace-c0cc78b3866a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d50f338-3d6c-4133-bb4c-489dd0a7166e", "device": "/dev/sdb"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:57.581096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a859fafb-d306-47e6-8ace-c0cc78b3866a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:57.587722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a859fafb-d306-47e6-8ace-c0cc78b3866a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.588449 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a859fafb-d306-47e6-8ace-c0cc78b3866a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.590196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a859fafb-d306-47e6-8ace-c0cc78b3866a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.591076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a859fafb-d306-47e6-8ace-c0cc78b3866a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.591690 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a859fafb-d306-47e6-8ace-c0cc78b3866a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.592274 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a859fafb-d306-47e6-8ace-c0cc78b3866a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.600502 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:57.601171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:57.613030 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.617978 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.618678 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.619604 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:57.620907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:57.627223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:57.932908 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:57.946891 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:57.952390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:57.956574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c1c93fd1-7fa9-4da9-8cac-c303d0424969 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1738 microversion: 2.20 time: 0.360609 Aug 31 00:21:57.958873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 226/444] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:57 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:57.967412 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:57.968334 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:58.004509 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.007119 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.009037 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.010017 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.011287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.012511 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.733544 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a859fafb-d306-47e6-8ace-c0cc78b3866a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "POST /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.159593 Aug 31 00:21:58.735181 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 219/445] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:21:57 2022] POST /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b/os-volume_attachments => generated 194 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:58.741546 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:58.742525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:58.750452 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.751334 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.751925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.752938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.753550 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.754170 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.780911 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:58.792758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-51e57a21-b1bb-412a-9bcf-e6e3e29eb123 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1713 microversion: 2.1 time: 0.832314 Aug 31 00:21:58.793512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 227/446] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:57 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1713 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:58.816139 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-fd85d2ab-129a-400a-8f26-29798acce175 req-012a8706-03a1-4772-9f45-a416010e5a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f28e21f-660b-450f-9880-aa1b2b5a6e29", "tag": "49a7aa6e-4699-4230-9b6f-018c8e0162ed"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:58.827203 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-fd85d2ab-129a-400a-8f26-29798acce175 req-012a8706-03a1-4772-9f45-a416010e5a0a service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.828460 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-fd85d2ab-129a-400a-8f26-29798acce175 req-012a8706-03a1-4772-9f45-a416010e5a0a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.829261 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-fd85d2ab-129a-400a-8f26-29798acce175 req-012a8706-03a1-4772-9f45-a416010e5a0a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.861425 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-fd85d2ab-129a-400a-8f26-29798acce175 req-012a8706-03a1-4772-9f45-a416010e5a0a service nova] Creating event network-changed:49a7aa6e-4699-4230-9b6f-018c8e0162ed for instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 on hv-cinder-85220 Aug 31 00:21:58.867893 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-fd85d2ab-129a-400a-8f26-29798acce175 req-012a8706-03a1-4772-9f45-a416010e5a0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071252 Aug 31 00:21:58.868784 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 228/447] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:21:58.982414 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:21:58.983215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:21:58.991496 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.992132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.992804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:58.993943 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:21:58.994596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:21:58.995223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:21:59.003969 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:59.016332 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a0097e2e-557d-40f2-9ac3-b91c383a5148 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.279577 Aug 31 00:21:59.017197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 220/448] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:21:58 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:21:59.197827 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:59.206931 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:59.208772 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:21:59.210250 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c4506c16-67b2-4fb7-8e3f-76e935390575 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1720 microversion: 2.20 time: 0.232072 Aug 31 00:21:59.211098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 229/449] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:21:58 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:21:59.258740 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e1343fb7-44f5-48a4-a445-23ba8c2740c4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Action: 'create', calling method: .version_select at 0x7fcd6bd8dca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-903737389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtyJPZE6/OuPaa5i8FUlH2Yd9bzvMZzB0G0M0jm87uS8jBkMEGoeFRpwLiomw9rhTNXiw8XO2sQLA/ukt7/harhjQdSGwfPYcvpkaqNAi2BejzCWZBDVEu+NI0l+1PKGA=="}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:21:59.276840 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-e1343fb7-44f5-48a4-a445-23ba8c2740c4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Getting quotas for project 167da5798ea2451a9888a661b3c7f3e6. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:21:59.281083 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-e1343fb7-44f5-48a4-a445-23ba8c2740c4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Getting quotas for user 5d8054341c0e46778e3b3db0b3dd1164 and project 167da5798ea2451a9888a661b3c7f3e6. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:21:59.309613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e1343fb7-44f5-48a4-a445-23ba8c2740c4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.279247 Aug 31 00:21:59.318273 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 221/450] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:21:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:00.038685 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:00.039901 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:00.046934 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:00.047658 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:00.048244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.049148 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:00.049739 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:00.050335 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.243968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:00.245410 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:00.256195 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.258792 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:00.259485 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:00.260743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.261638 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:00.262488 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:00.263068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:00.267781 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f783826a-1aff-4986-bed7-41cfe523ae4a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.231808 Aug 31 00:22:00.268376 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 230/451] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:00 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:00.425343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.434435 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.436308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:00.437671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fb70cb69-9f09-49d7-a066-bcb47ec5ca73 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1720 microversion: 2.20 time: 0.201063 Aug 31 00:22:00.459783 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 222/452] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:00 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1720 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:01.288317 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:01.288930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:01.302543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.303313 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.303932 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.304927 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.305453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.305915 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.464468 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:01.465837 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:01.470493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:01.476518 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.477915 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.478459 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.479503 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.479962 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.480390 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.485616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:01.494088 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2ef8a85b-2263-4187-b308-b8e24ca1d9e6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.209503 Aug 31 00:22:01.497968 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 231/453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:01 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:01.619848 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:01.628854 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:01.630331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:01.631589 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-dd4eeeb2-cdf1-4c1c-b821-e008a4397eb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1720 microversion: 2.20 time: 0.171159 Aug 31 00:22:01.632142 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 223/454] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:01 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:01.905373 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-9c0ab66b-3dbb-41cd-af0f-0de362fd5a48 req-56134696-9b8a-404b-8232-1bcd9c7bddb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28862807-4ab6-4376-9e01-b40cd4e4483a", "name": "network-vif-unplugged", "status": "completed", "tag": "07e1f3ff-ed06-4bbc-af49-616e3dd80848"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:01.916372 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-9c0ab66b-3dbb-41cd-af0f-0de362fd5a48 req-56134696-9b8a-404b-8232-1bcd9c7bddb5 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:01.916864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-9c0ab66b-3dbb-41cd-af0f-0de362fd5a48 req-56134696-9b8a-404b-8232-1bcd9c7bddb5 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:01.917297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-9c0ab66b-3dbb-41cd-af0f-0de362fd5a48 req-56134696-9b8a-404b-8232-1bcd9c7bddb5 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:01.930364 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-9c0ab66b-3dbb-41cd-af0f-0de362fd5a48 req-56134696-9b8a-404b-8232-1bcd9c7bddb5 service nova] Creating event network-vif-unplugged:07e1f3ff-ed06-4bbc-af49-616e3dd80848 for instance 28862807-4ab6-4376-9e01-b40cd4e4483a on hv-cinder-85220 Aug 31 00:22:01.935413 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-9c0ab66b-3dbb-41cd-af0f-0de362fd5a48 req-56134696-9b8a-404b-8232-1bcd9c7bddb5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033682 Aug 31 00:22:01.936238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 232/455] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:02.515694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:02.516316 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:02.523548 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.524028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.524463 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.525148 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.525600 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.526130 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.652490 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.655510 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:02.656216 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:02.660806 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1ff6187e-ff23-4e63-907f-668adb4e5aef tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.148934 Aug 31 00:22:02.661383 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 224/456] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:02 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:02.663294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.664048 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.664580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.665288 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:02.665742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:02.666206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:02.810902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.819894 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.821366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:02.822566 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6b6f758b-3ba6-40f2-b3a9-16fbff0e82ac tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1720 microversion: 2.20 time: 0.171789 Aug 31 00:22:02.823124 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 233/457] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:02 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:03.681583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:03.682222 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:03.689760 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.690293 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.690737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.691442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.691898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.692322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.823097 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:03.831313 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-798c4d97-4b46-4770-9454-d2e3ba5e2ca3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.153571 Aug 31 00:22:03.831883 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 225/458] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:03 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:03.847050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:03.847875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:03.854596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.855083 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.855517 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.856236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:03.856728 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:03.857199 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:03.986723 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:03.994795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:03.996234 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:03.997389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d1ba6ed2-631e-4fa0-8f48-1af0befebc42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1720 microversion: 2.20 time: 0.155070 Aug 31 00:22:03.997988 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 234/459] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:03 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:04.852188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:04.852734 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:04.859483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:04.859974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:04.860433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:04.863833 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:04.863833 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:04.863833 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:04.991875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:04.999465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9d4dd8bf-5c3f-4da0-b5d1-05613d868932 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.151277 Aug 31 00:22:05.000058 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 226/460] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:04 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:05.020492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:05.021123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:05.027836 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.028375 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.028800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.029491 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.029987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.030405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.165731 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:05.174611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:05.176061 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:05.177220 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cc914c67-4799-4888-bf2d-4ea79f484ba7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1723 microversion: 2.20 time: 0.160705 Aug 31 00:22:05.177772 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 235/461] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:05 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:05.199418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-86e26273-aa23-440f-a75c-42a3cbb02748 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "136d7549-743e-43a4-ac5a-548ff7341d40"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:05.201927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-86e26273-aa23-440f-a75c-42a3cbb02748 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:05.208487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-86e26273-aa23-440f-a75c-42a3cbb02748 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.208967 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-86e26273-aa23-440f-a75c-42a3cbb02748 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.209393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-86e26273-aa23-440f-a75c-42a3cbb02748 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.210102 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-86e26273-aa23-440f-a75c-42a3cbb02748 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.210548 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-86e26273-aa23-440f-a75c-42a3cbb02748 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.210966 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-86e26273-aa23-440f-a75c-42a3cbb02748 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.533124 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:05.542607 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-86e26273-aa23-440f-a75c-42a3cbb02748 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.347219 Aug 31 00:22:05.543216 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 227/462] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 31 00:22:05 2022] POST /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments => generated 188 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:22:05.669713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:05.670353 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:05.676506 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.676983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.677416 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.678136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.678587 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.679007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.722126 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132201) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:22:05.791497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-811462bb-35f9-49fc-a992-bfe159462ff1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/action" status: 202 len: 0 microversion: 2.20 time: 0.125673 Aug 31 00:22:05.792104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 236/463] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 31 00:22:05 2022] POST /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:22:05.802495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:05.803400 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:05.813114 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.813478 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.814042 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:05.815460 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:05.815991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:05.816486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:06.021825 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:06.024071 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:06.053542 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:06.054451 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:06.057489 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:06.058623 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:06.059251 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:06.060025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:06.068754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:06.079112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:06.082336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:06.084874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-139252e4-29e7-4595-8cb5-955d32569860 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1809 microversion: 2.20 time: 0.288572 Aug 31 00:22:06.100201 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 228/464] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:05 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:06.112006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:06.246477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:06.254848 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-175f85ac-ea5f-4e59-808b-4419759b469f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.238221 Aug 31 00:22:06.255427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 237/465] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:06 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:07.112371 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:07.112973 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:07.120199 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:07.120732 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:07.121161 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.121870 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:07.122372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:07.122790 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.256629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:07.265913 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:07.267353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:07.269120 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-42d740d6-2dc6-42a5-a67b-a232c9da5a8b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1749 microversion: 2.20 time: 0.160849 Aug 31 00:22:07.269672 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 229/466] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:07 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:07.275196 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:07.275926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:07.282134 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:07.282614 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:07.283046 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.283873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:07.284398 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:07.284897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:07.418384 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:07.426205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-43ee3280-b978-4a32-90ec-cc9fd768aee5 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.154806 Aug 31 00:22:07.426761 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 238/467] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:07 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:08.292330 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:08.292974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:08.300404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.300876 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:08.301302 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:08.302024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.302470 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:08.302886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:08.435005 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:08.444472 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:08.446080 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:08.447366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2f59210e-9c7c-45c0-af8d-ef4037b4ccd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1749 microversion: 2.20 time: 0.158940 Aug 31 00:22:08.448015 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 230/468] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:08 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:08.454054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:08.454054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:08.457788 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.458331 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:08.458766 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:08.459456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:08.459904 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:08.460322 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:08.592858 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:08.601091 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-90fc7c4e-3e3d-4c15-85da-554aaa554a6c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.155195 Aug 31 00:22:08.601727 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 239/469] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:08 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:09.471439 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:09.471985 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:09.473921 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=18 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:09.480098 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:09.480588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:09.481059 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:09.481753 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:09.482294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:09.482836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:09.616896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:09.623392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:09.624252 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:09.626357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:09.628595 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:09.629429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-80bdff32-b701-4ff5-b540-4b4ef1b02920 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1749 microversion: 2.20 time: 0.162827 Aug 31 00:22:09.630184 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 231/470] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:09 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:09.633056 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:09.633548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:09.634426 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:09.634803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:09.635268 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:09.636000 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:09.772102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:09.779856 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c674f2ec-e6b3-45d0-8f55-024177fc002b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.161366 Aug 31 00:22:09.780434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 240/471] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:09 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:10.653622 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:10.654252 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:10.661224 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.661723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.662163 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.662849 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.663298 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.663722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.791957 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:10.800873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:10.801458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:10.801581 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:10.802442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:10.803605 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a7514176-f072-44da-9f9a-728876733b61 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1749 microversion: 2.20 time: 0.154104 Aug 31 00:22:10.804161 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 232/472] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:10 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:10.808033 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.808518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.808959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.809648 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:10.810122 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:10.810551 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:10.939787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:10.947454 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-219df238-aca0-4d23-8136-3303cb38876d tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.150507 Aug 31 00:22:10.948017 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 241/473] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:10 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:11.826497 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:11.827677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:11.837258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.837746 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.838432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:11.839230 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.839712 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.840143 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:11.968841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:11.969444 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:11.975989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.976470 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.976904 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:11.977600 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:11.978082 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:11.978504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:11.990299 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:11.999188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:12.000612 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:12.001776 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4688a808-58bb-447f-b63a-50d7f7f79e1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1749 microversion: 2.20 time: 0.179371 Aug 31 00:22:12.003189 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 233/474] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:11 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:12.114135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:12.121759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a594e7d3-6a97-442c-a9e7-ed6032d11775 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.156949 Aug 31 00:22:12.122352 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 242/475] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:11 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:13.025197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:13.025923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:13.032347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.032891 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.033372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.034081 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.034528 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.034942 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.143078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:13.143691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:13.149882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.155091 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.155670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.156536 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:13.156943 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:13.157644 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:13.169194 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:13.182753 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:13.194466 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:13.195682 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-79c02ce0-5d3d-4d93-920c-0f3739d010a7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1749 microversion: 2.20 time: 0.174354 Aug 31 00:22:13.196264 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 234/476] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:13 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:13.298021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:13.306317 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7258d013-2dac-4d76-a1b3-dad6e1077ed6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.167516 Aug 31 00:22:13.307011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 243/477] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:13 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:14.219041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:14.219576 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:14.226673 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:14.227153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:14.227587 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:14.228271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:14.228723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:14.229145 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:14.327080 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:14.327798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:14.335825 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:14.336405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:14.336923 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:14.337720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:14.338292 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:14.338793 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:14.358529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:14.367759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:14.369181 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:14.370357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-aeeed9bf-69a3-4d29-b9aa-f44bf53889c8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1749 microversion: 2.20 time: 0.155238 Aug 31 00:22:14.370902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 235/478] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:14 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:14.472005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:14.480141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2922ff9d-38b6-4e37-a7ec-2a6fa033379f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.156993 Aug 31 00:22:14.480710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 244/479] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:14 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:15.394229 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:15.394781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:15.401234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.401699 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.402157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.402829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.403269 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.403695 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.500784 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:15.501315 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:15.508442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.508932 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.509374 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.510107 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:15.510563 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:15.510989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:15.534825 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:15.543415 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:15.544859 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:15.546364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-00a60a4c-13b2-49c1-96c8-0b1c166c10a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1749 microversion: 2.20 time: 0.156252 Aug 31 00:22:15.546939 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 236/480] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:15 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:15.636241 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:15.644599 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-be15e1b0-21b7-41ed-bd09-a7849fd9b3a4 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.147946 Aug 31 00:22:15.645112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 245/481] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:15 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:16.207290 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-e8975f70-a9d4-46f0-b068-60c58eb2f13b req-f0a20a16-b570-41eb-8708-c6afff97f3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f28e21f-660b-450f-9880-aa1b2b5a6e29", "name": "network-vif-plugged", "status": "completed", "tag": "49a7aa6e-4699-4230-9b6f-018c8e0162ed"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:16.218155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-e8975f70-a9d4-46f0-b068-60c58eb2f13b req-f0a20a16-b570-41eb-8708-c6afff97f3aa service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.218631 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-e8975f70-a9d4-46f0-b068-60c58eb2f13b req-f0a20a16-b570-41eb-8708-c6afff97f3aa service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.219261 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-e8975f70-a9d4-46f0-b068-60c58eb2f13b req-f0a20a16-b570-41eb-8708-c6afff97f3aa service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.233714 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-e8975f70-a9d4-46f0-b068-60c58eb2f13b req-f0a20a16-b570-41eb-8708-c6afff97f3aa service nova] Creating event network-vif-plugged:49a7aa6e-4699-4230-9b6f-018c8e0162ed for instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 on hv-cinder-85220 Aug 31 00:22:16.239952 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-e8975f70-a9d4-46f0-b068-60c58eb2f13b req-f0a20a16-b570-41eb-8708-c6afff97f3aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036859 Aug 31 00:22:16.240555 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 237/482] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:22:16.568352 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:16.568949 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:16.575580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.576061 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.576493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.577191 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.577638 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.578076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.665440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:16.666432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:16.673268 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.673828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.674297 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.674999 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:16.675986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:16.676761 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:16.716488 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:16.725948 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:16.727800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:16.729228 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-936b2b81-9a3b-42ab-9ba1-c1f784c679cb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1751 microversion: 2.20 time: 0.164793 Aug 31 00:22:16.729827 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 246/483] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:16 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:16.812805 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:16.821097 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ef39ef9c-8260-457a-8b92-479fbcaa6210 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.160203 Aug 31 00:22:16.821737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 238/484] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:16 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:17.752558 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:17.754159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:17.760752 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:17.761216 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:17.761655 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:17.762381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:17.762835 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:17.763259 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:17.841931 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:17.842553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:17.849145 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:17.849629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:17.850091 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:17.850788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:17.851242 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:17.851670 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:17.894009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:17.904621 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:17.906239 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:17.907304 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d752c0f4-364f-41af-9357-0c878e167abb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1751 microversion: 2.20 time: 0.158645 Aug 31 00:22:17.907859 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 247/485] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:17 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:17.987123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:17.994800 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f5045174-4d1c-4842-9a4a-39410731c006 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.156826 Aug 31 00:22:17.995366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 239/486] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:17 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:18.931140 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:18.931756 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:18.938399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.938882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.939319 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:18.940006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:18.940459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:18.941452 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:19.015818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:19.016405 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:19.023011 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:19.023493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:19.023927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:19.024619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:19.025066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:19.025487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:19.073137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:19.081712 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:19.083227 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:19.085400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2ca4a54d-a6f5-4d73-b9f2-12882c8236c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1751 microversion: 2.20 time: 0.157167 Aug 31 00:22:19.086067 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 248/487] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:18 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:19.153650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:19.161264 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c2985517-bd41-4ab5-923a-8672339fb1ae tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.149294 Aug 31 00:22:19.161863 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 240/488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:19 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:20.108317 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:20.108917 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:20.115552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:20.116032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:20.116467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:20.117168 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:20.117618 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:20.118078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:20.181582 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:20.182343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:20.188901 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:20.189385 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:20.189817 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:20.190534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:20.191500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:20.191921 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:20.248808 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:20.258662 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:20.260030 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:20.261203 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a9263a19-ee25-45aa-9f3a-46dbfbbb3507 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1751 microversion: 2.20 time: 0.156833 Aug 31 00:22:20.261764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 249/489] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:20 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:20.329869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:20.338527 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-18c55b4d-3c93-45a6-a264-233656120e34 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.160712 Aug 31 00:22:20.339003 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 241/490] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:20 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:21.284392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:21.285658 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:21.292274 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:21.292770 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:21.293208 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:21.293945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:21.294403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:21.294824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:21.359184 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:21.359719 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:21.366221 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:21.366706 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:21.367249 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:21.368002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:21.368750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:21.369305 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:21.428948 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:21.450701 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:21.452451 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:21.453868 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-260974a3-c1a3-4317-a06b-25bafd33da77 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1751 microversion: 2.20 time: 0.173362 Aug 31 00:22:21.455238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 250/491] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:21 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:21.510498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:21.518186 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-737a2408-b4c6-4237-9332-0d7f74098506 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.163017 Aug 31 00:22:21.518748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 242/492] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:21 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:22.476855 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:22.477466 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:22.484470 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:22.484959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:22.485395 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:22.486136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:22.486589 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:22.487018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:22.538656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:22.539254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:22.548966 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:22.549447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:22.549903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:22.551775 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:22.554237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:22.554793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:22.630683 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:22.639665 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:22.640928 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:22.642140 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0602f11c-a11f-4f4c-98c9-22ede24d5fc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1751 microversion: 2.20 time: 0.169261 Aug 31 00:22:22.642698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 251/493] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:22 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:22.696527 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:22.704163 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0998cd4a-8c3e-4fd2-9cc7-aded4840ce36 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1372 microversion: 2.1 time: 0.169430 Aug 31 00:22:22.704658 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 243/494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:22 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:23.667079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:23.668325 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:23.680001 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.680419 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.681943 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.683339 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.684475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.686303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.726657 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:23.727369 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:23.734661 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.735363 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.736066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.737101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.738338 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.739070 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.851258 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:23.860459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:23.863212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:23.864936 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f489b925-0dea-4155-bc69-bc0470e841d6 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1751 microversion: 2.20 time: 0.204291 Aug 31 00:22:23.868240 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 252/495] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:23 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:23.958904 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:23.962714 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=98 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:23.968297 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e7570da5-4db7-4227-9c72-26eab9c8b4f6 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1566 microversion: 2.1 time: 0.247447 Aug 31 00:22:23.968878 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 244/496] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:23 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1566 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:23.990159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-13ff4e25-28c6-431b-874d-53b89e2f0494 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:23.991062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-13ff4e25-28c6-431b-874d-53b89e2f0494 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:23.997687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13ff4e25-28c6-431b-874d-53b89e2f0494 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:23.998225 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13ff4e25-28c6-431b-874d-53b89e2f0494 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:23.998670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13ff4e25-28c6-431b-874d-53b89e2f0494 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:23.999801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13ff4e25-28c6-431b-874d-53b89e2f0494 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:24.000272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13ff4e25-28c6-431b-874d-53b89e2f0494 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:24.000737 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13ff4e25-28c6-431b-874d-53b89e2f0494 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:24.082422 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-13ff4e25-28c6-431b-874d-53b89e2f0494 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096125 Aug 31 00:22:24.083023 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 253/497] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 31 00:22:23 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:24.888653 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:24.889375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:24.897041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:24.897787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:24.898408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:24.899416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:24.900079 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:24.900705 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.079990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-3cf87654-82a2-4c02-83a6-ff92b98ceb93 req-46997c29-7c64-40f0-b3c6-fbefeccf47a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f28e21f-660b-450f-9880-aa1b2b5a6e29", "tag": "49a7aa6e-4699-4230-9b6f-018c8e0162ed"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:25.085897 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:25.096480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:25.099763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:25.101711 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:25.106411 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-3cf87654-82a2-4c02-83a6-ff92b98ceb93 req-46997c29-7c64-40f0-b3c6-fbefeccf47a8 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.107815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c4d156a6-700d-4425-b08e-dbf9855c3a1c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.223235 Aug 31 00:22:25.108396 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 245/498] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:24 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:25.109046 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-3cf87654-82a2-4c02-83a6-ff92b98ceb93 req-46997c29-7c64-40f0-b3c6-fbefeccf47a8 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.109666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-3cf87654-82a2-4c02-83a6-ff92b98ceb93 req-46997c29-7c64-40f0-b3c6-fbefeccf47a8 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.130529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-3cf87654-82a2-4c02-83a6-ff92b98ceb93 req-46997c29-7c64-40f0-b3c6-fbefeccf47a8 service nova] Creating event network-changed:49a7aa6e-4699-4230-9b6f-018c8e0162ed for instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 on hv-cinder-85220 Aug 31 00:22:25.135665 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-3cf87654-82a2-4c02-83a6-ff92b98ceb93 req-46997c29-7c64-40f0-b3c6-fbefeccf47a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060185 Aug 31 00:22:25.136302 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 254/499] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:22:25.885807 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:25.886570 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:25.893355 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.894608 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.895121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:25.895984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:25.896688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:25.897206 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.030875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lazy-loading 'services' on Instance uuid ad2ac443-640c-4200-b515-84ee80e2ef9b {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:22:26.132429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:26.135233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:26.151369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:26.151897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:26.152326 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.153758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:26.154346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:26.154701 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:26.160741 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:26.160971 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e8c03290-37af-4015-b757-8105ee7bd07b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b/os-volume_attachments/1d50f338-3d6c-4133-bb4c-489dd0a7166e" status: 202 len: 0 microversion: 2.1 time: 0.277786 Aug 31 00:22:26.164422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 246/500] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:22:25 2022] DELETE /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b/os-volume_attachments/1d50f338-3d6c-4133-bb4c-489dd0a7166e => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:22:26.330981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:26.341193 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:26.350573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:26.357226 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9591d307-6172-493c-9954-9c1184ed36fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.229441 Aug 31 00:22:26.363477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 255/501] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:26 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:27.385921 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:27.387266 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:27.389702 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:27.395958 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:27.396443 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:27.396881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:27.397583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:27.398086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:27.398510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:27.530996 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:27.540085 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:27.541521 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:27.542715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1d03a3ed-9c04-4290-9254-e2697365fcbd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.161851 Aug 31 00:22:27.543281 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 247/502] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:27 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:28.564847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:28.565367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:28.567706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:22:28.567857 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Wed Aug 31 00:22:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a (ip 10.222.0.49) !!! Aug 31 00:22:28.579315 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:28.579798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:28.580235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:28.580929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:28.581955 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:28.582384 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:28.714825 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:28.724084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:28.725519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:28.726707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f7d45a10-9f3e-43c9-81cc-67dfa1eb21a2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.165906 Aug 31 00:22:28.727257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 256/503] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:28 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:29.748407 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:29.749019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:29.756022 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:29.756539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:29.756975 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:29.757663 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:29.758152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:29.758577 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:29.905322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:29.915529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:29.917820 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:29.919322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-71b10fe0-4eba-4cb4-a725-d500625fc9fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.174752 Aug 31 00:22:29.920057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 248/504] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:29 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:30.952464 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:30.953126 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:30.960276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:30.960759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:30.961197 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:30.961916 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:30.962376 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:30.962803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:31.116832 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:31.126112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:31.127498 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:31.128952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7d78a3c9-fa26-4d92-9abd-d39532f6d941 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.180336 Aug 31 00:22:31.129517 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 257/505] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:30 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:32.152614 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:32.153322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:32.163287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.163465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.166958 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:32.168421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:32.168914 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:32.169366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:32.319873 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:32.328809 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:32.330282 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:32.331966 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d75492dc-195f-4c54-9f55-f1ecb86869b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.183275 Aug 31 00:22:32.332525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 249/506] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:32 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:33.355646 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:33.356236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:33.363271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:33.363754 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:33.364195 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:33.364885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:33.365340 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:33.365769 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:33.516494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:33.538786 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:33.541434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:33.551606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2ae78759-25a3-485f-a23f-9aa3cec9e7cc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.199959 Aug 31 00:22:33.566446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 258/507] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:33 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:34.575078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:34.576452 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:34.585578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.586315 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.587016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.587807 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:34.588427 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:34.588858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:34.756730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:34.765724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:34.767650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:34.769367 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f96e44d9-367d-4fcb-ac92-3b4efaa1df4c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.198270 Aug 31 00:22:34.782258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 250/508] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:34 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:35.791876 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:35.793075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:35.801106 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.801603 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.802075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.802782 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:35.803240 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:35.803679 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:35.938475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:35.947046 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:35.948496 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:35.949656 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-df700426-df9a-4687-a434-5007a6042321 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.161986 Aug 31 00:22:35.950253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 259/509] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:35 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:36.972802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:36.973407 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:36.980045 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.980530 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.980961 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:36.981654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:36.982136 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:36.982561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:37.127256 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:37.136895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:37.138481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:37.139653 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-29bae422-2fa7-4bbd-a38b-018882598ecf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.171366 Aug 31 00:22:37.142118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 251/510] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:36 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:38.164626 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:38.165454 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:38.172232 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.172720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.173159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.173937 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:38.175045 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:38.175480 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:38.307409 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.315993 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.317446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:38.318636 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6a201d08-93c9-4b1e-8dd7-e03addc7303c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.158606 Aug 31 00:22:38.319189 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 260/511] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:38 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:39.341938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:39.342549 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:39.349035 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.349520 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.349986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.350685 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:39.351140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:39.351570 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:39.498749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:39.508197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:39.509616 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:39.510790 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-47012585-92ff-4101-b017-24dda07b8a5d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.172775 Aug 31 00:22:39.511654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 252/512] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:39 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:40.535031 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:40.535853 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:40.543585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.544134 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.544604 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.545307 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:40.546087 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:40.546514 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:40.688575 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.699538 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.700997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:40.702220 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3fb4b4af-6114-408d-8097-16a86cc3857f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.171672 Aug 31 00:22:40.702801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 261/513] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:40 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:41.724845 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:41.725442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:41.731923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.732401 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.732831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.733513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:41.733997 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:41.734420 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:41.867495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:41.877453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:41.880441 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:41.882140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a2dfb4ee-93c3-4a22-bf18-5f6fe59e66f9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.161094 Aug 31 00:22:41.882949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 253/514] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:41 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:42.755078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1171459065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-903737389", "security_groups": [{"name": "tempest-secgroup-smoke-1230119711"}], "block_device_mapping_v2": [{"uuid": "d55cede5-14ea-4f8c-8d2d-9eba4d8557af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4c2507f0-77f6-4977-b074-6f8caa46b647"}]}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:42.871771 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] validate_networks() for [('4c2507f0-77f6-4977-b074-6f8caa46b647', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:22:42.905793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:42.906412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:42.913493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.914009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.914445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:42.915130 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:42.915582 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:42.916004 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.074855 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.085684 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.087176 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.088346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5dcc221b-c420-45c7-9409-b450383f86dd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.186439 Aug 31 00:22:43.088908 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 254/515] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:42 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:43.295151 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:22:43.295828 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:22:43.296298 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:22:43.296700 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:22:43.297133 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:22:43.305708 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:43.306213 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:43.306646 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.307363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:43.307809 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:43.308230 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:43.326151 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Getting quotas for project 167da5798ea2451a9888a661b3c7f3e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:22:43.330323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Getting quotas for user 5d8054341c0e46778e3b3db0b3dd1164 and project 167da5798ea2451a9888a661b3c7f3e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:22:43.393110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:22:43.395835 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d55cede5-14ea-4f8c-8d2d-9eba4d8557af',volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:22:43.531625 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b7f52c8e-d8d9-4198-9e79-9d404453bff2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.780495 Aug 31 00:22:43.532263 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 262/516] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:22:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:22:43.543196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b64ec447-4b99-45b5-b32c-725994f5850b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:43.543813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b64ec447-4b99-45b5-b32c-725994f5850b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:43.609096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b64ec447-4b99-45b5-b32c-725994f5850b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:43.615828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b64ec447-4b99-45b5-b32c-725994f5850b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1094 microversion: 2.1 time: 0.076529 Aug 31 00:22:43.626196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 255/517] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:43 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:44.113194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:44.114376 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:44.120522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.121008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.121445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.122160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.122615 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.123040 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.254003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.262960 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.264404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.265585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8f36b9e3-5b9e-40c5-a9d8-3328ec0b7b07 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.157021 Aug 31 00:22:44.266245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 263/518] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:44 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:44.638977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:44.639584 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:44.647137 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.647622 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.648057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.648744 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:44.649197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:44.649626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:44.709294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:44.716943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3061d5cf-035e-4709-af15-aca2c2afa0b5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1136 microversion: 2.1 time: 0.081813 Aug 31 00:22:44.717513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 256/519] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:44 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1136 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:45.289598 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:45.290255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:45.297007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.297531 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.298091 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.298697 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.299152 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.299617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.434875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:45.443507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:45.444959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:45.446142 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-94cbe6cf-8410-450b-acb3-2484a8d0f184 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.160561 Aug 31 00:22:45.446698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 264/520] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:45 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:45.737416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:45.738057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:45.745047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.745527 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.745984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.746669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:45.747171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:45.747595 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:45.809671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:45.817371 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-eb43eea3-540b-402b-8cd1-8a98695ea1be tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1192 microversion: 2.1 time: 0.083776 Aug 31 00:22:45.817984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 257/521] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:45 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:46.440257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.440798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.447507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.447997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.448449 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.449134 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.449589 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.450046 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.468997 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.470199 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.476745 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.477226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.477670 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.478034 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:22:46.478380 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.478991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.479412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.565145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8de6b169-0a44-4cf7-af6f-0e8f7e805da4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 204 len: 0 microversion: 2.1 time: 0.128310 Aug 31 00:22:46.565728 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 265/522] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:22:46 2022] DELETE /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:22:46.575991 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.576890 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.583514 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.584018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.584512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.585218 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.585676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.586132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.626162 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.635739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.637186 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.638406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d0b8aedf-8143-42eb-87d0-f358c7d3e709 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.173638 Aug 31 00:22:46.639015 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 258/523] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:46 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:46.742273 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.751242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-15c1dbac-18c6-40b0-91d6-9fa6d6aba69d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1559 microversion: 2.1 time: 0.180486 Aug 31 00:22:46.751809 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 266/524] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:46 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:46.837439 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:46.838093 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:46.844443 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.844923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.845523 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.846078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:46.846525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:46.846951 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:46.909023 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:46.920124 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9cce938c-0985-4f9a-bfbd-3faa39747aa3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1192 microversion: 2.1 time: 0.084408 Aug 31 00:22:46.920124 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 259/525] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:46 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:47.662910 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:47.663516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:47.669868 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.670359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.671239 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.671934 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.672415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.672805 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.782943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:47.783846 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:47.790399 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.790910 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.791570 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.792240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.792700 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.793123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.836168 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.844943 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.846416 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.847621 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-db648438-0300-4b68-be55-a401f2a6f45b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.189173 Aug 31 00:22:47.848225 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 267/526] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:47 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:47.927070 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:47.936192 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-26ee9f65-6cfc-49f0-9ac9-113425a3ed65 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1513 microversion: 2.1 time: 0.156983 Aug 31 00:22:47.936781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 260/527] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:47 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:47.940600 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:47.941259 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:47.947636 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.948378 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.949097 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:47.950215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:47.950765 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:47.951434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.013182 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:48.020856 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-473f1bf8-43f8-4854-b69b-d8d730af5883 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1192 microversion: 2.1 time: 0.084961 Aug 31 00:22:48.021421 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 268/528] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:47 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:48.873003 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:48.873610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:48.880496 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.880963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.881413 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.882121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.882565 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.882978 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.959827 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:48.960428 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:48.966844 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.967322 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.967752 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:48.968435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:48.968880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:48.969343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.015037 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.018523 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:49.024623 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.026096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.027245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-eb4176b9-8f43-48b3-bb28-605032b903c5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.158185 Aug 31 00:22:49.027800 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 261/529] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:48 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:49.040190 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:49.040700 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:49.047345 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.047834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.048268 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.048972 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:49.049419 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:49.049853 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:49.111112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.120080 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-23453b7e-81a6-4805-8f00-aaea06783b6c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1513 microversion: 2.1 time: 0.164189 Aug 31 00:22:49.121796 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 269/530] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:48 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:49.123864 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:49.132285 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-715a0c3c-2625-4d25-bee1-be4fc9e844b4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1192 microversion: 2.1 time: 0.095783 Aug 31 00:22:49.133003 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 262/531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:49 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:50.051656 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:50.052253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:50.058695 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.059183 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.059607 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.060297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.060748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.061166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.141715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:50.142365 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:50.149488 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.150000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.150441 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.151140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.151599 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.152025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.193778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.197493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:50.204061 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.205583 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.206883 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-19b4ba9a-03c4-45b2-949d-75db3e729f20 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.159147 Aug 31 00:22:50.207511 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 270/532] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:50 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:50.211948 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:50.212772 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:50.219799 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.220387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.221010 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.221708 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.222698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.223133 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.283543 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.285748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.293292 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cae47258-36e2-42a3-a65d-c47516347ba6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1513 microversion: 2.1 time: 0.155418 Aug 31 00:22:50.293956 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 263/533] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:50 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:50.294698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-74fd1905-974c-4665-a56e-182f93f2a455 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1192 microversion: 2.1 time: 0.085961 Aug 31 00:22:50.295676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 271/534] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:50 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:50.299123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-06bb34f5-ea95-4f64-a381-107cd3847a97 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:50.302149 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-06bb34f5-ea95-4f64-a381-107cd3847a97 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:50.308592 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-06bb34f5-ea95-4f64-a381-107cd3847a97 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.309086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-06bb34f5-ea95-4f64-a381-107cd3847a97 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.309527 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-06bb34f5-ea95-4f64-a381-107cd3847a97 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.310262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-06bb34f5-ea95-4f64-a381-107cd3847a97 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.310722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-06bb34f5-ea95-4f64-a381-107cd3847a97 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.311156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-06bb34f5-ea95-4f64-a381-107cd3847a97 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.389888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-06bb34f5-ea95-4f64-a381-107cd3847a97 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "POST /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/action" status: 202 len: 0 microversion: 2.1 time: 0.094578 Aug 31 00:22:50.390501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 264/535] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:22:50 2022] POST /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:22:50.399172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:50.399811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:50.405767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.406276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.406713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.407396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.407850 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.408272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.553872 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:50.562122 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ff04498c-5804-4cdb-a651-3ed3df8deff5 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1748 microversion: 2.1 time: 0.166795 Aug 31 00:22:50.562688 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 272/536] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:50 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:50.816740 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-035f46cc-736a-4d44-a269-29e5c546d51d req-fdb9cf31-c838-486a-a88d-78516a633404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28862807-4ab6-4376-9e01-b40cd4e4483a", "name": "network-vif-plugged", "status": "completed", "tag": "07e1f3ff-ed06-4bbc-af49-616e3dd80848"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:50.826194 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-035f46cc-736a-4d44-a269-29e5c546d51d req-fdb9cf31-c838-486a-a88d-78516a633404 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:50.826668 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-035f46cc-736a-4d44-a269-29e5c546d51d req-fdb9cf31-c838-486a-a88d-78516a633404 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:50.827098 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-035f46cc-736a-4d44-a269-29e5c546d51d req-fdb9cf31-c838-486a-a88d-78516a633404 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:50.838107 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-035f46cc-736a-4d44-a269-29e5c546d51d req-fdb9cf31-c838-486a-a88d-78516a633404 service nova] Creating event network-vif-plugged:07e1f3ff-ed06-4bbc-af49-616e3dd80848 for instance 28862807-4ab6-4376-9e01-b40cd4e4483a on hv-cinder-85220 Aug 31 00:22:50.842754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-035f46cc-736a-4d44-a269-29e5c546d51d req-fdb9cf31-c838-486a-a88d-78516a633404 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030150 Aug 31 00:22:50.843329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 265/537] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:51.229778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:51.230418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:51.236885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.237369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.237826 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.238691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.239147 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.239576 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.317249 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:51.318129 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:51.324339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.324962 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.325709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.326507 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.327054 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.327817 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.391982 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:51.400134 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a934fa04-d013-44c4-80a4-5f5c076aefaf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1200 microversion: 2.1 time: 0.087511 Aug 31 00:22:51.400698 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 266/538] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:51 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:51.405064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:51.405689 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:51.412928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.413428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.414259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.415001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.415391 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.415845 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.417800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:51.426909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:51.428361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:51.429529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6cf8268e-0750-4eea-9fa6-00ae6a56f830 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.203662 Aug 31 00:22:51.430108 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 273/539] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:51 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:51.553776 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:51.561888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ef871460-1f53-4e31-be1f-aa88bc0d61f6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1513 microversion: 2.1 time: 0.160211 Aug 31 00:22:51.562460 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 267/540] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:51 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:51.584374 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:51.584980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:51.590912 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.591383 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.591814 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.592486 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:51.592930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:51.593346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:51.980443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.000551 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-884041df-5f12-4059-a45e-cbe8df98c113 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1748 microversion: 2.1 time: 0.420642 Aug 31 00:22:52.010036 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 274/541] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:51 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1748 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:52.420938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:52.421559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:52.428845 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.429329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.429969 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.430666 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.431279 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.431709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.455829 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:52.457041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:52.466359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.467354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.468213 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.469264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.470385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.471308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.561282 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.569813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fd6e56c6-ce27-4e55-bcbf-34d7f69f877b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1210 microversion: 2.1 time: 0.152975 Aug 31 00:22:52.570482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 268/542] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:52 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1210 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:52.583734 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:52.584571 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:52.590809 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.591233 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.591678 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.592379 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:52.592830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:52.593434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:52.618433 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.627068 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.628538 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:52.629699 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-14829eaf-0a3e-4bd0-b93d-fda0a2b6ddff tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.180114 Aug 31 00:22:52.630367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 275/543] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:52 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:22:53.030465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:53.031322 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:53.037748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.038561 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.039302 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.040236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.040854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.041442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.107921 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.117756 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3f163d2e-86e8-4997-8308-93493c5bd1ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1513 microversion: 2.1 time: 0.538259 Aug 31 00:22:53.118748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 269/544] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:52 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1513 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:53.210858 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.223404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c543033b-d8ce-4c08-bf3a-ccd66a19d510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1748 microversion: 2.1 time: 0.196685 Aug 31 00:22:53.223994 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 276/545] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:53 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1748 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:53.260732 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-3e53e819-4f6e-400b-afc5-ed2d4e0729c0 req-b47d6a24-9e06-48ad-b315-d5e675afde20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2ac443-640c-4200-b515-84ee80e2ef9b", "name": "network-vif-deleted", "tag": "77f81145-8f7a-4f02-886d-93eaf00ce9b6"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:53.270807 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3e53e819-4f6e-400b-afc5-ed2d4e0729c0 req-b47d6a24-9e06-48ad-b315-d5e675afde20 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.271377 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3e53e819-4f6e-400b-afc5-ed2d4e0729c0 req-b47d6a24-9e06-48ad-b315-d5e675afde20 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.271900 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3e53e819-4f6e-400b-afc5-ed2d4e0729c0 req-b47d6a24-9e06-48ad-b315-d5e675afde20 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.284245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-3e53e819-4f6e-400b-afc5-ed2d4e0729c0 req-b47d6a24-9e06-48ad-b315-d5e675afde20 service nova] Creating event network-vif-deleted:77f81145-8f7a-4f02-886d-93eaf00ce9b6 for instance ad2ac443-640c-4200-b515-84ee80e2ef9b on hv-cinder-85220 Aug 31 00:22:53.289551 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-3e53e819-4f6e-400b-afc5-ed2d4e0729c0 req-b47d6a24-9e06-48ad-b315-d5e675afde20 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032820 Aug 31 00:22:53.290183 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 270/546] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:22:53.593990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:53.594951 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:53.597634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:53.598389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=6 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:53.603854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.604634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.605258 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.606022 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.606487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.606916 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.650403 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:53.655821 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:53.656519 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:53.665124 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.665900 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.666527 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.667237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:53.667746 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:53.668340 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:53.767656 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.776115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-69d49560-cefe-4122-be82-f54666a04ecf tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1278 microversion: 2.1 time: 0.186390 Aug 31 00:22:53.776950 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 277/547] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:53 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:53.815578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.824808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.826553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:53.827795 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-97035052-d867-4dc7-8e25-7e8aef31f7ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.179034 Aug 31 00:22:53.828350 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 271/548] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:53 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:54.140657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:54.141365 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:54.148709 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.149281 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.149790 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.150650 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.151179 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.151703 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.182932 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.183535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.183974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.184515 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lazy-loading 'fault' on Instance uuid ad2ac443-640c-4200-b515-84ee80e2ef9b {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:22:54.231481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:54.239311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-eb55697f-378c-450a-bcc9-93bcc2647047 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1308 microversion: 2.1 time: 0.102675 Aug 31 00:22:54.239870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 278/549] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:54 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:54.244303 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:54.244970 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:54.252500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.253280 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.253742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.254492 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.254937 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.255356 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.521442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:54.553006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-65e67591-5b77-4868-9375-289462c7dde6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.312626 Aug 31 00:22:54.569667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 272/550] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:54 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:54.797809 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:54.799931 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:54.807823 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.808238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.808666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.809592 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.810072 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.810490 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.851849 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:54.853294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:54.872051 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.872872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.873739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.875236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:54.875236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:54.875499 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:54.961157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:54.971403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bbaa753b-ea93-4937-aabb-d7d406de0eef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.178392 Aug 31 00:22:54.972861 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 279/551] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:54 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:55.021298 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.031330 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.032917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.034167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-78a88698-df2d-494b-89b1-e05a35c2dc51 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1807 microversion: 2.20 time: 0.186862 Aug 31 00:22:55.035286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 273/552] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:54 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:55.260506 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:55.261112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:55.262999 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:55.268139 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.268619 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.269677 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.270399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.270853 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.271277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.303326 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.303741 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.304180 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.304632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lazy-loading 'fault' on Instance uuid ad2ac443-640c-4200-b515-84ee80e2ef9b {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:22:55.306479 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-42fbc5ad-337d-42ac-a8c7-95b2c6d999c2 req-cd4772d2-53f2-4471-ae20-37930e2c98db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d7ee56-2da9-457b-86e3-bc28a16e747b", "tag": "60491f5f-efbb-4927-ab3f-df70a22c8355"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:22:55.316610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-42fbc5ad-337d-42ac-a8c7-95b2c6d999c2 req-cd4772d2-53f2-4471-ae20-37930e2c98db service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.317106 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-42fbc5ad-337d-42ac-a8c7-95b2c6d999c2 req-cd4772d2-53f2-4471-ae20-37930e2c98db service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.317737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-42fbc5ad-337d-42ac-a8c7-95b2c6d999c2 req-cd4772d2-53f2-4471-ae20-37930e2c98db service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.330306 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-42fbc5ad-337d-42ac-a8c7-95b2c6d999c2 req-cd4772d2-53f2-4471-ae20-37930e2c98db service nova] Creating event network-changed:60491f5f-efbb-4927-ab3f-df70a22c8355 for instance 17d7ee56-2da9-457b-86e3-bc28a16e747b on hv-cinder-85220 Aug 31 00:22:55.336662 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-42fbc5ad-337d-42ac-a8c7-95b2c6d999c2 req-cd4772d2-53f2-4471-ae20-37930e2c98db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033985 Aug 31 00:22:55.337664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 274/553] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:22:55.350959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.360252 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b983e0e0-4bd8-4b1e-8b56-4f9894884bb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1308 microversion: 2.1 time: 0.103685 Aug 31 00:22:55.360831 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 280/554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:55 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:55.577526 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:55.578252 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:55.584506 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.585261 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.585601 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.586421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:55.586884 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:55.587311 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:55.806568 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:55.817349 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-709febc8-19a0-4b98-a30f-4b062f24f084 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.243891 Aug 31 00:22:55.818292 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 275/555] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:55 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:55.993205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:55.993820 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:56.000420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.001109 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.001330 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.002078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.002537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.002963 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.057784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:56.058403 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:56.066588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.067943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.068531 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.069403 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.070058 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.071421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.146548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.154207 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3724451b-f605-4cfd-9c1a-7abdf56ef579 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.164910 Aug 31 00:22:56.154773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 281/556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:55 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:56.226147 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.234676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.236103 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.237244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1f954e80-576a-4489-9cd5-865f059667da tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1794 microversion: 2.20 time: 0.183326 Aug 31 00:22:56.238356 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 276/557] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:22:56 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1794 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:22:56.381754 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:56.382794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:56.389284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.389989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.390517 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.391308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.391941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.392383 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.426783 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.427264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.427694 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.428143 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lazy-loading 'fault' on Instance uuid ad2ac443-640c-4200-b515-84ee80e2ef9b {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:22:56.469895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.479390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cffb31b0-f7a0-4a53-95bc-86a3f2adbfb2 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 200 len: 1308 microversion: 2.1 time: 0.101551 Aug 31 00:22:56.480369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 282/558] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:56 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:56.839016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:56.839625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:56.845628 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.846141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.846576 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.847277 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:56.847731 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:56.848153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:56.988978 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:56.998200 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bce98b01-b21d-48a7-969e-804ebd0318de tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.163023 Aug 31 00:22:56.998778 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 277/559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:56 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:22:57.175925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:57.176668 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:57.183418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.183992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.184414 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:57.185094 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.185540 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.185987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:57.328894 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:57.336720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9da49eb1-9073-4fea-aad2-c68e0e0b6442 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.165133 Aug 31 00:22:57.337297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 283/560] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:57 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:57.502093 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:57.503347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: ad2ac443-640c-4200-b515-84ee80e2ef9b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:57.505838 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=64 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:57.511067 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.511552 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.511981 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:57.512676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:57.513129 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:57.513549 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:57.527782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] HTTP exception thrown: Instance ad2ac443-640c-4200-b515-84ee80e2ef9b could not be found. Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Request method failure captured: Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b HTTP/1.1 Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqlabWuovwhe8qfB39fIwDHH6ElVHmcgwFTa269LR09F3q5FklGhY7PvyPkzuwcNV66Vdv5gaARXnHbliigV57yKtMebrMiAmB_qNbm5qlxlTMtDU5dBShgv25rtHhHgS_SU2nGqB-JAmoeljlLQmXYYAmc_2vb-UQzx3p8A2z9gqIw Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 80dbc22f8641481291939540b00e0225 Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1992499973 Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:22:57.529429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/80dbc22f8641481291939540b00e0225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80dbc22f8641481291939540b00e0225"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80dbc22f8641481291939540b00e0225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_80dbc22f8641481291939540b00e0225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-VolumesSnapshotTestJSON-1992499973 Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 80dbc22f8641481291939540b00e0225 Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1992499973 Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-VolumesSnapshotTestJSON-1992499973-project Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 4e57290be8d341db824952c83703b118 Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-VolumesSnapshotTestJSON-1992499973-project Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance ad2ac443-640c-4200-b515-84ee80e2ef9b could not be found. Aug 31 00:22:57.531029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': 'ad2ac443-640c-4200-b515-84ee80e2ef9b'} Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad2ac443-640c-4200-b515-84ee80e2ef9b could not be found. Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:22:57.531943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad2ac443-640c-4200-b515-84ee80e2ef9b could not be found. Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad2ac443-640c-4200-b515-84ee80e2ef9b could not be found. Aug 31 00:22:57.533244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:22:57.534925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Returning 404 to user: Instance ad2ac443-640c-4200-b515-84ee80e2ef9b could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:22:57.534925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a229920e-41c7-4663-a893-8176f6ea1880 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b" status: 404 len: 111 microversion: 2.1 time: 0.034197 Aug 31 00:22:57.534925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 278/561] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:57 2022] GET /compute/v2.1/servers/ad2ac443-640c-4200-b515-84ee80e2ef9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:58.020095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:58.020706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:58.026721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:58.027229 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:58.027987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:58.028340 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:58.028792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:58.029217 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:58.173745 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:58.187180 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ccede0f0-b16e-4877-9d90-0173e90becb8 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.171161 Aug 31 00:22:58.187825 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 284/562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:58 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:58.357177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:58.357786 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:58.364041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:58.364516 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:58.364945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:58.365626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:58.366100 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:58.366519 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:58.500803 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:58.510031 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c914f3ad-144a-4b6f-a1a3-971966b67209 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.156635 Aug 31 00:22:58.510633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 279/563] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:58 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:59.208669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:59.209486 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:59.216526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.217012 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.217451 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.218179 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.218632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.219054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.359604 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:59.368003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-99000d7b-b685-4172-b215-e8f66aed5446 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.163383 Aug 31 00:22:59.368736 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 285/564] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:59 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:22:59.530937 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:22:59.531555 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:22:59.538842 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.539331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.539745 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.540430 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:22:59.540872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:22:59.541288 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:22:59.545562 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:59.676312 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:22:59.683968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d3c93f96-2cf7-4de0-87cb-c9f0be0d7ac2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.156850 Aug 31 00:22:59.684528 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 280/565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:22:59 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:00.391361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:00.391991 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:00.398750 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.399348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.399802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.400510 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.400967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.401390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.422357 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:00.554766 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:00.563094 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5e29e062-ce32-4f44-95c1-2f31785e2af1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.177650 Aug 31 00:23:00.563667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 286/566] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:00 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:00.704575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:00.705087 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:00.711568 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.712047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.712481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.713160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:00.713608 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:00.714059 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:00.856847 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:00.864878 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d8954d7a-d725-477e-a193-2a03514798a2 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.164204 Aug 31 00:23:00.865447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 281/567] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:00 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:01.586190 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:01.586857 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:01.593182 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:01.593654 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:01.594116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:01.594801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:01.595249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:01.595668 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:01.736378 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:01.744636 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b4c19e35-5a71-4cab-a39c-114c0b2f607f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.162873 Aug 31 00:23:01.745187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 287/568] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:01 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:01.885287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:01.885932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:01.892383 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:01.892866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:01.893363 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:01.894072 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:01.894523 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:01.895513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.029900 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:02.038432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0a3c12e8-018f-4bf4-abde-64c54d5c80a1 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.156890 Aug 31 00:23:02.039004 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 282/569] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:01 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:02.765388 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:02.765943 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:02.772611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.773089 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.773518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.774233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:02.774678 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:02.775098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:02.921074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:02.931424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d7c48aad-aa4c-4f94-ab0c-68a343a1ff84 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.169793 Aug 31 00:23:02.938006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 288/570] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:02 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:03.059943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:03.060549 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:03.067159 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.067635 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.068067 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.068752 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.069229 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.069649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.199406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:03.207895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9e71e9aa-dbbe-416e-827d-bf1dfdb52ab9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.151267 Aug 31 00:23:03.208467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 283/571] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:03 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:03.952543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:03.953156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:03.959862 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.960341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.960811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:03.961488 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:03.961976 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:03.962400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.119104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:04.128297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-11e77ea5-3349-4066-87b8-43cc19b67dbe tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.179587 Aug 31 00:23:04.128877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 289/572] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:03 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:04.230414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:04.230414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:04.236410 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.236938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.237411 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.238218 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:04.239540 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:04.240031 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:04.383816 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:04.391677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ff496f2b-0cfc-4235-a313-b5fd20d2665f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.167118 Aug 31 00:23:04.392243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 284/573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:04 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:05.149990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:05.150596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:05.156946 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:05.157420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:05.157871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:05.158547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:05.159037 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:05.159403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:05.298644 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:05.306762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d0e2549d-28d4-4321-88bb-0b75e4529763 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.160662 Aug 31 00:23:05.307329 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 290/574] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:05 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:05.413655 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:05.414343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:05.420923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:05.421392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:05.421817 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:05.422515 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:05.422960 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:05.423377 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:05.552620 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:05.560359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3d00ae7e-563d-4f7b-8b17-d150c923a3c6 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.151141 Aug 31 00:23:05.560939 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 285/575] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:05 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:06.327218 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:06.327822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:06.334285 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.334759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.335189 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.335866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.336309 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.336725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.478475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:06.486636 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-dffbe42c-6d95-4215-a246-2a56dce4e510 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.163177 Aug 31 00:23:06.487194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 291/576] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:06 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:06.581137 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:06.581688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:06.588235 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.588720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.589160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.589930 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:06.590329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:06.590754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:06.724477 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:06.733165 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-52653cd4-77e7-460b-a79f-345cc7c94bad tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.155655 Aug 31 00:23:06.734067 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 286/577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:06 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:07.508015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:07.508633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:07.514669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.515152 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.515588 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.516278 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.516730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.517154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.656537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:07.665339 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3f1fff42-ba2a-440a-b492-9487822d3e9e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.161396 Aug 31 00:23:07.665928 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 292/578] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:07 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:07.754933 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:07.755542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:07.761984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.762463 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.762900 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.763583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:07.764034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:07.764457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:07.901360 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:07.909339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-51032c91-11ee-4aea-86c5-80a89748c633 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.158708 Aug 31 00:23:07.909926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 287/579] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:07 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:08.491319 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1249659733", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "networks": [{"uuid": "755938eb-dd0e-4f83-9aaf-3ed1966456ce"}]}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:08.544526 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] validate_networks() for [('755938eb-dd0e-4f83-9aaf-3ed1966456ce', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:23:08.686262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:08.686868 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:08.693486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.693996 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.694434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.695127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.695578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.696000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.847266 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:08.866445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9d5c3086-b0da-4201-acdf-0ab80d4ad64e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.183942 Aug 31 00:23:08.870955 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 288/580] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:08 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:08.925547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:23:08.926030 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:23:08.926512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:23:08.926925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:23:08.927341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:23:08.930602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:08.931295 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:08.936251 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.936735 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.937204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.937619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.938040 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.938158 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.938497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.938613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.938934 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.939265 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:08.939756 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:08.940187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:08.956355 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Getting quotas for project 80dbc22f8641481291939540b00e0225. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:23:08.960953 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Getting quotas for user 4e57290be8d341db824952c83703b118 and project 80dbc22f8641481291939540b00e0225. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:23:08.972172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:23:08.974544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:23:09.024143 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f16563bd-42bc-4f72-bc87-4b9bfdb38eb5 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534798 Aug 31 00:23:09.024143 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 293/581] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:23:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:23:09.033644 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e2b9666f-0725-4be4-802f-821b7b251b60 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:09.034279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e2b9666f-0725-4be4-802f-821b7b251b60 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:09.084382 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:09.090909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e2b9666f-0725-4be4-802f-821b7b251b60 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:09.094454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cf4549d4-a3e0-4512-8f29-8a0c4a98f3e3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.167858 Aug 31 00:23:09.095279 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 289/582] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:08 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:09.107180 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e2b9666f-0725-4be4-802f-821b7b251b60 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1219 microversion: 2.1 time: 0.077331 Aug 31 00:23:09.107772 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 294/583] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:09 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:09.892713 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:09.893173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:09.900943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:09.901581 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:09.902225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:09.903035 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:09.903677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:09.904155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:10.048812 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:10.057135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-243e3f9a-b22f-47e8-ae0a-79aa23266f8c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.168948 Aug 31 00:23:10.057701 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 290/584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:09 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:10.114873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:10.115487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:10.122690 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:10.123173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:10.123817 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:10.124507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:10.124962 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:10.125391 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:10.127986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:10.128599 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:10.136157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:10.136635 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:10.137064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:10.137760 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:10.138301 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:10.138796 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:10.199938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:10.208696 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-379d64e4-0353-400e-95c3-81e30eb5d696 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1271 microversion: 2.1 time: 0.084436 Aug 31 00:23:10.209288 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 291/585] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:10 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:10.254562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:10.262203 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-fd9b0bd5-2bbd-409a-b7b0-2d3d3ab5ff69 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.151145 Aug 31 00:23:10.262764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 295/586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:10 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:10.500161 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-62677689-f514-42b7-84a3-ea79f0aa487f req-4a482ee2-01bc-452c-808a-43ff15b3f318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d7ee56-2da9-457b-86e3-bc28a16e747b", "name": "network-vif-plugged", "status": "completed", "tag": "60491f5f-efbb-4927-ab3f-df70a22c8355"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:10.510239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-62677689-f514-42b7-84a3-ea79f0aa487f req-4a482ee2-01bc-452c-808a-43ff15b3f318 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:10.510786 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-62677689-f514-42b7-84a3-ea79f0aa487f req-4a482ee2-01bc-452c-808a-43ff15b3f318 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:10.511432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-62677689-f514-42b7-84a3-ea79f0aa487f req-4a482ee2-01bc-452c-808a-43ff15b3f318 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:10.523451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-62677689-f514-42b7-84a3-ea79f0aa487f req-4a482ee2-01bc-452c-808a-43ff15b3f318 service nova] Creating event network-vif-plugged:60491f5f-efbb-4927-ab3f-df70a22c8355 for instance 17d7ee56-2da9-457b-86e3-bc28a16e747b on hv-cinder-85220 Aug 31 00:23:10.528541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-62677689-f514-42b7-84a3-ea79f0aa487f req-4a482ee2-01bc-452c-808a-43ff15b3f318 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032101 Aug 31 00:23:10.529360 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 292/587] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:11.077620 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:11.089217 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:11.095671 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.096148 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.096606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.097326 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.098366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.098817 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.231527 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:11.233123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:11.241683 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.242569 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.243258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.244181 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.244890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.245533 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.282375 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:11.297416 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-02cf9ec8-247d-485d-9b10-3b607525c2b2 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.223941 Aug 31 00:23:11.298748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 296/588] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:11 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:11.304879 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:11.306221 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:11.314427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.315354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.316864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.318016 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:11.318683 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:11.319504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:11.369376 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:11.377438 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-004d3385-5411-47a0-99e3-6b9cafd5c2ab tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1289 microversion: 2.1 time: 0.151870 Aug 31 00:23:11.378149 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 293/589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:11 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:11.482722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:11.490304 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7f59e55e-fed7-4dcd-80f1-d1bc76960d5a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.190254 Aug 31 00:23:11.490864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 297/590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:11 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:12.319106 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:12.319890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:12.326414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.326889 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.327316 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.327997 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.328440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.328859 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.398649 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:12.399262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:12.405778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.406300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.406754 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.407428 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.407880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.408335 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.469020 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:12.478629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-64278f27-9e51-4638-addc-d176aae7df10 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.163870 Aug 31 00:23:12.479204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 294/591] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:12 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:12.510457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:12.511163 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:12.517204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.517690 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.518292 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.518987 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:12.519482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:12.519917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:12.537018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:12.544732 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3c126bf4-6baf-46ab-8c49-832c0696f52a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.149868 Aug 31 00:23:12.545503 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 298/592] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:12 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:12.663198 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:12.671561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-972adf7b-664c-4635-89c2-7fa54647808f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1266 microversion: 2.1 time: 0.165188 Aug 31 00:23:12.672150 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 295/593] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:12 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:13.210395 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-6e783bd7-e34f-4d08-9fb2-3c7faf5ed603 req-930cf4ae-f96d-43ce-8fca-8214a4195f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ae81fb-ca61-416f-874d-f1cd8dbec710", "tag": "b8968ff6-2d32-4404-935f-0921cc1806db"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:13.220280 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-6e783bd7-e34f-4d08-9fb2-3c7faf5ed603 req-930cf4ae-f96d-43ce-8fca-8214a4195f34 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.220782 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-6e783bd7-e34f-4d08-9fb2-3c7faf5ed603 req-930cf4ae-f96d-43ce-8fca-8214a4195f34 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.221211 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-6e783bd7-e34f-4d08-9fb2-3c7faf5ed603 req-930cf4ae-f96d-43ce-8fca-8214a4195f34 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.232277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-6e783bd7-e34f-4d08-9fb2-3c7faf5ed603 req-930cf4ae-f96d-43ce-8fca-8214a4195f34 service nova] Creating event network-changed:b8968ff6-2d32-4404-935f-0921cc1806db for instance d5ae81fb-ca61-416f-874d-f1cd8dbec710 on hv-cinder-85220 Aug 31 00:23:13.237519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-6e783bd7-e34f-4d08-9fb2-3c7faf5ed603 req-930cf4ae-f96d-43ce-8fca-8214a4195f34 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030831 Aug 31 00:23:13.240440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 299/594] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:23:13.500731 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.501439 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:13.508516 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.508996 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.509436 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.510159 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.510615 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.511038 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.567558 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.568583 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:13.577113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.577604 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.578077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.578778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.579233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.579828 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.659705 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.669834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-13377856-45dd-4190-855d-80265f5a5f07 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.173749 Aug 31 00:23:13.670719 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 296/595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:13.692415 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.693026 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:13.698949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.699434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.699868 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.700558 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.701018 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.701442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.720297 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:13.724574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.732399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bfd334db-d344-4e30-8d07-6513fdcdd7cb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.169474 Aug 31 00:23:13.733184 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 300/596] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:13.839320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:13.847001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-33fb0bf3-f63c-4cc7-8dc6-3db142a9006c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1452 microversion: 2.1 time: 0.158506 Aug 31 00:23:13.848265 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 297/597] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:13.869042 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:13.869653 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:13.875699 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.876177 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.876612 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:13.877300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:13.877754 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:13.878230 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.009753 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:14.017391 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b7d852a4-5ae5-40c5-94be-d070f4d951f5 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1452 microversion: 2.1 time: 0.152303 Aug 31 00:23:14.017983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 301/598] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:13 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:14.691925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:14.692506 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:14.699263 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.699751 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.700395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.701098 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.701712 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.702320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.752870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:14.754235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:14.760786 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.761280 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.761716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.762630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:14.763276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:14.763701 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:14.940747 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:14.949357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0d42943c-e3c3-4d02-8620-3ba9439974c9 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.261661 Aug 31 00:23:14.952153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 298/599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:14 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:14.990509 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:14.998731 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-81c72abf-97af-4585-930d-4f43a31b4779 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.249710 Aug 31 00:23:14.999295 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 302/600] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:14 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:15.857551 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-c3c56c1b-470f-445a-8849-270ecedf0234 req-10efd52d-6252-48b4-b41d-59dd88f83bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d7ee56-2da9-457b-86e3-bc28a16e747b", "tag": "60491f5f-efbb-4927-ab3f-df70a22c8355"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:15.868151 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-c3c56c1b-470f-445a-8849-270ecedf0234 req-10efd52d-6252-48b4-b41d-59dd88f83bbf service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.868633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-c3c56c1b-470f-445a-8849-270ecedf0234 req-10efd52d-6252-48b4-b41d-59dd88f83bbf service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.869063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-c3c56c1b-470f-445a-8849-270ecedf0234 req-10efd52d-6252-48b4-b41d-59dd88f83bbf service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.880943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-c3c56c1b-470f-445a-8849-270ecedf0234 req-10efd52d-6252-48b4-b41d-59dd88f83bbf service nova] Creating event network-changed:60491f5f-efbb-4927-ab3f-df70a22c8355 for instance 17d7ee56-2da9-457b-86e3-bc28a16e747b on hv-cinder-85220 Aug 31 00:23:15.886103 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-c3c56c1b-470f-445a-8849-270ecedf0234 req-10efd52d-6252-48b4-b41d-59dd88f83bbf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032292 Aug 31 00:23:15.886888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 299/601] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:15.970613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:15.971256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:15.977714 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.978217 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.978645 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:15.979320 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:15.979761 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:15.980175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.020143 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:16.020836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:16.027238 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.027729 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.028164 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.028857 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:16.029489 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:16.029957 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:16.179921 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:16.187975 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f171bcf6-f08b-447c-8c02-6d713a3fa2f0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.171938 Aug 31 00:23:16.188935 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 300/602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:16 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:16.382385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:16.391290 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7ac50208-57e0-4f9d-bdbf-822571f8d99a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.424517 Aug 31 00:23:16.391884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 303/603] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:15 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:17.208656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:17.209449 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:17.216210 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.216926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.217374 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.218187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.218641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.219067 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.416156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:17.416694 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:17.423641 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.424152 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.424598 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.425325 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:17.425757 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:17.426208 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:17.426310 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:17.435787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4e3d399f-8bbc-4744-b41e-87955266143a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.231158 Aug 31 00:23:17.436375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 301/604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:17 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:17.571087 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:17.579272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ef4a37cc-ae8c-419c-8157-0f54e8c9b330 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.167083 Aug 31 00:23:17.579835 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 304/605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:17 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:18.456182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:18.456781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:18.463241 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.463720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.464154 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.464840 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.465293 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.465715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.590886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:18.599122 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e24ee4d6-b440-4486-ad5a-c5278f08c06c tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.146997 Aug 31 00:23:18.599687 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 302/606] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:18 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:18.601093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:18.601702 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:18.608134 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.608609 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.609038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.609711 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:18.610348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:18.610766 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:18.628838 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:18.754477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:18.762666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5eae2a8f-38b1-46b2-a9ec-ec6169acc39a tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.166135 Aug 31 00:23:18.763260 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 305/607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:18 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:19.620091 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:19.620653 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:19.627091 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.627568 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.628020 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.628690 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.629137 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.629558 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.759858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:19.767567 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-060ef50b-3809-4ffe-bdf9-d2f9aa7eb8e9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.151423 Aug 31 00:23:19.768131 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 303/608] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:19 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:19.784419 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:19.785687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:19.787590 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:19.788362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=8 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:19.794345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.794846 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.795527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.796213 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:19.796667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:19.797093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:19.939404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:19.948110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-edf5dd93-a71f-463a-b4ab-cba6c0fc58dc tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.167589 Aug 31 00:23:19.948681 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 306/609] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:19 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:20.788886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:20.789491 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:20.796488 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.796967 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.797398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.798184 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.798636 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.799061 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.930528 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:20.938088 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d39e1748-d8f7-4da5-b911-1c06ae41699b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.153121 Aug 31 00:23:20.938652 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 304/610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:20 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:20.968301 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:20.968937 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:20.975681 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.976160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.976592 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:20.977284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:20.977730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:20.978175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.120204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:21.129034 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d69af14b-5363-4d93-ab2c-92cc4ccefb5e tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1753 microversion: 2.1 time: 0.163938 Aug 31 00:23:21.129599 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 307/611] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:20 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:21.959204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:21.959816 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:21.966276 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.966754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.967227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:21.967916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:21.968370 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:21.968792 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.104001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:22.111858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4d69799b-e8f9-464c-ae66-e098e0b0406d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.156550 Aug 31 00:23:22.112517 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 305/612] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:21 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:22.149715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:22.150363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:22.156502 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.156990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.157425 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.158147 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:22.158600 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:22.159026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:22.309034 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:22.317839 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-02c16a06-d528-4986-829b-7a38f4b1e694 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1756 microversion: 2.1 time: 0.171993 Aug 31 00:23:22.318429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 308/613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:22 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:23.036202 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:23.036754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:23.043542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.044029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.044475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.045450 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.045978 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.046408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.126271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lazy-loading 'services' on Instance uuid acd82cf1-9e95-469a-ae36-ffca42f83f3a {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:23.132499 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:23.133235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:23.140354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.140834 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.141265 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.141981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.142431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.142884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.202416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-026dc1ff-ce3a-4158-b7c8-7bca45f6a547 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "DELETE /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/os-volume_attachments/61cad0b4-710c-47a3-9489-bac1345b455c" status: 202 len: 0 microversion: 2.1 time: 0.170474 Aug 31 00:23:23.203048 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 306/614] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:23:23 2022] DELETE /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/os-volume_attachments/61cad0b4-710c-47a3-9489-bac1345b455c => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:23:23.285415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:23.293073 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-072c6f27-7323-4a37-b49e-09571264d1e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.164519 Aug 31 00:23:23.293642 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 309/615] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:23 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:23.837546 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-20f3315f-bb4d-405d-a889-2f5166400a14 req-78030497-8da2-4e99-b8cc-3da80ce0937a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ae81fb-ca61-416f-874d-f1cd8dbec710", "name": "network-vif-plugged", "status": "completed", "tag": "b8968ff6-2d32-4404-935f-0921cc1806db"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:23.849551 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-20f3315f-bb4d-405d-a889-2f5166400a14 req-78030497-8da2-4e99-b8cc-3da80ce0937a service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:23.850068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-20f3315f-bb4d-405d-a889-2f5166400a14 req-78030497-8da2-4e99-b8cc-3da80ce0937a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:23.850501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-20f3315f-bb4d-405d-a889-2f5166400a14 req-78030497-8da2-4e99-b8cc-3da80ce0937a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:23.861780 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-20f3315f-bb4d-405d-a889-2f5166400a14 req-78030497-8da2-4e99-b8cc-3da80ce0937a service nova] Creating event network-vif-plugged:b8968ff6-2d32-4404-935f-0921cc1806db for instance d5ae81fb-ca61-416f-874d-f1cd8dbec710 on hv-cinder-85220 Aug 31 00:23:23.870153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-20f3315f-bb4d-405d-a889-2f5166400a14 req-78030497-8da2-4e99-b8cc-3da80ce0937a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036489 Aug 31 00:23:23.870481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 307/616] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:24.313518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:24.314178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:24.320763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.321245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.321681 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.322410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:24.322861 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:24.323283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:24.451262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:24.459488 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-949b9b40-1897-4a2c-b0a8-dcd759a31f7d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.149758 Aug 31 00:23:24.460103 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 310/617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:24 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:25.481658 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:25.482385 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:25.488510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:25.489601 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:25.490086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:25.490779 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:25.491226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:25.491648 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:25.617702 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:25.625485 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bf86afce-df03-48ca-8308-b6327394c488 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.148597 Aug 31 00:23:25.626075 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 308/618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:25 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:26.645653 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:26.646404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:26.648659 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:26.654053 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.654540 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.654977 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.655668 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:26.656121 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:26.656547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:26.787494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:26.795892 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a571fd50-1259-4d6b-94e9-b24389a491a6 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.154055 Aug 31 00:23:26.796469 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 311/619] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:26 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:27.817034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:27.817642 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:27.820186 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=62 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:27.825696 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.826206 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.826641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.827352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:27.827802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:27.828223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:27.954188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:27.962357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-75770a26-a981-4928-997f-731bf25485e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.149219 Aug 31 00:23:27.962920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 309/620] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:27 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:28.983362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:28.983974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:28.991175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.991650 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.992086 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:28.992768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:28.993249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:28.993670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:29.124060 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:29.131687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-72435364-5cb8-4ddb-9543-45f9a71a3c86 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.152207 Aug 31 00:23:29.132250 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 312/621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:28 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:30.152354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:30.152903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:30.159484 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:30.159964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:30.160993 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:30.161684 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:30.162205 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:30.162633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:30.286807 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:30.294977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6618b9f2-3ef3-44b6-bd76-c6203f4fce3b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.146285 Aug 31 00:23:30.295538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 310/622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:30 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:31.315730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:31.316343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:31.322907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.323390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.323830 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.324516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:31.324973 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:31.325397 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:31.453646 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:31.461331 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-dde27d41-3f34-49b3-8c60-4502bbcf4935 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.149477 Aug 31 00:23:31.461920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 313/623] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:31 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:32.482467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:32.483110 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:32.490086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.490564 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.490999 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.491679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:32.492126 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:32.492547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:32.623325 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:32.630982 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ee31ea0f-bf51-435a-aeb3-b2d6ce9ba96d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.152334 Aug 31 00:23:32.631543 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 311/624] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:32 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:33.651821 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:33.652449 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:33.658896 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.659366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.659792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.660467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:33.660911 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:33.661327 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:33.786762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:33.794260 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-86fa4426-d5e0-4a8e-bd08-4e97fd40ec35 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.146242 Aug 31 00:23:33.795174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 314/625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:33 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:34.814946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:34.815554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:34.822735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:34.823217 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:34.823653 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:34.824341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:34.824800 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:34.825225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:34.920520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1f4bdccb-b33c-4098-ac1f-9bc76c1cbf74 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:34.927718 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1f4bdccb-b33c-4098-ac1f-9bc76c1cbf74 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:34.928218 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1f4bdccb-b33c-4098-ac1f-9bc76c1cbf74 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:34.928657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1f4bdccb-b33c-4098-ac1f-9bc76c1cbf74 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:34.972012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:34.980370 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e2e1f2f5-e928-4682-b3d5-0e18118173a9 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.169190 Aug 31 00:23:34.980945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 312/626] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:34 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:34.993724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1f4bdccb-b33c-4098-ac1f-9bc76c1cbf74 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Going to try to stop instance {{(pid=132201) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 00:23:35.035871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1f4bdccb-b33c-4098-ac1f-9bc76c1cbf74 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/action" status: 202 len: 0 microversion: 2.1 time: 0.126701 Aug 31 00:23:35.036456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 315/627] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:23:34 2022] POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:23:35.045034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:35.045641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:35.052243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:35.052723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:35.053160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:35.053839 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:35.054309 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:35.054745 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:35.180625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:35.188284 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f082e99b-d61e-46f8-9b7e-21074a03f432 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.147488 Aug 31 00:23:35.188851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 313/628] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:35 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:36.002820 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:36.003722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:36.010558 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.011058 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.011497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.012192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.012756 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.013189 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.140307 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:36.147869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d9104072-3cbe-4ded-8711-5ad4ce05e9ca tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1319 microversion: 2.1 time: 0.149889 Aug 31 00:23:36.148433 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 316/629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:35 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:36.209603 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:36.210233 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:36.216874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.217359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.217789 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.219225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.219686 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.220283 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.350122 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:36.353529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:36.358540 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-aca566ed-5a1f-49aa-b20b-fb3c600d9175 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.153933 Aug 31 00:23:36.359103 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 314/630] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:36 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:36.789736 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3430de47-9cae-4baf-9df9-f185770fce19 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdc8ae1a-8320-4962-8fa1-36205b830373"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:36.792206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3430de47-9cae-4baf-9df9-f185770fce19 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:36.798789 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3430de47-9cae-4baf-9df9-f185770fce19 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.799274 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3430de47-9cae-4baf-9df9-f185770fce19 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.799721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3430de47-9cae-4baf-9df9-f185770fce19 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:36.800411 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3430de47-9cae-4baf-9df9-f185770fce19 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:36.800869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3430de47-9cae-4baf-9df9-f185770fce19 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:36.801298 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3430de47-9cae-4baf-9df9-f185770fce19 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.168818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:37.169420 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:37.175770 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.176240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.176674 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.177345 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.177788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.178230 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.303932 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3430de47-9cae-4baf-9df9-f185770fce19 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518640 Aug 31 00:23:37.304894 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 317/631] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:23:36 2022] POST /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments => generated 194 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:37.318718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:37.329730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e11f69b1-4f74-45d1-90a5-90c453716637 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1508 microversion: 2.1 time: 0.164858 Aug 31 00:23:37.330762 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 315/632] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:37 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:37.352060 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bce58fc9-d393-418a-a8be-8859988ffd3d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7532742-74c9-4e96-9ec8-66a7ece6b991", "device": "/dev/sdb"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:37.358061 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bce58fc9-d393-418a-a8be-8859988ffd3d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:37.361492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bce58fc9-d393-418a-a8be-8859988ffd3d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.362013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bce58fc9-d393-418a-a8be-8859988ffd3d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.362476 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bce58fc9-d393-418a-a8be-8859988ffd3d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.363152 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bce58fc9-d393-418a-a8be-8859988ffd3d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.363606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bce58fc9-d393-418a-a8be-8859988ffd3d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.364057 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bce58fc9-d393-418a-a8be-8859988ffd3d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.380939 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:37.381550 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:37.387444 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.387932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.388364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.389050 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:37.389503 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:37.389950 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:37.519563 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:37.527372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a7ba6dc7-4c43-4558-abbe-32a1d8020c9b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.150768 Aug 31 00:23:37.527934 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 316/633] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:37 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:23:37.716176 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:37.735254 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bce58fc9-d393-418a-a8be-8859988ffd3d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "POST /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387874 Aug 31 00:23:37.736106 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 318/634] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:23:37 2022] POST /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:23:38.548545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:38.549150 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:38.555689 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.556173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.556606 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.557294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:38.557746 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:38.558203 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:38.685601 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:38.693950 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3a40918d-2d93-44c6-b19c-7bf9bb857d13 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.149464 Aug 31 00:23:38.694522 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 317/635] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:38 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:39.715349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:39.715971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:39.722818 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:39.723298 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:39.723738 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:39.724422 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:39.725477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:39.725929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:39.859449 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:39.866820 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-373641e1-d488-4ce3-9fba-57c1f34face3 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.155820 Aug 31 00:23:39.868724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 319/636] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:39 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:40.887303 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:40.887900 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:40.894436 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.894915 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.895350 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:40.896034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:40.896521 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:40.896946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:41.023358 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:41.031166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-23bb6521-372a-4747-81dd-20755228c477 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.147727 Aug 31 00:23:41.031728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 318/637] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:40 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:42.052289 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:42.053444 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:42.060157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:42.060632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:42.061068 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:42.061754 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:42.062235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:42.062664 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:42.187494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:42.195817 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1c4bf28a-bb0c-4a31-b925-eafc81cc33b5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.147345 Aug 31 00:23:42.196379 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 320/638] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:42 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:43.216819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:43.217339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:43.223837 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:43.224317 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:43.224750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:43.225434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:43.225912 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:43.226336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:43.356473 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:43.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b6f12d09-2c55-4e00-838b-af358cc82fdd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.151194 Aug 31 00:23:43.364653 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 319/639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:43 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:44.385186 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:44.385703 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:44.392141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:44.392627 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:44.393064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:44.393749 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:44.394231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:44.394656 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:44.525410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:44.533327 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-81dd835c-06e9-40bf-ab15-da3527939d1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.152672 Aug 31 00:23:44.533838 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 321/640] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:44 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:45.554631 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:45.555220 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:45.560999 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.561469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.561926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.562602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.563081 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.563497 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.691005 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:45.699265 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9972639b-04db-4f43-9b28-b122b4ec47f1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.148650 Aug 31 00:23:45.699926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 320/641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:45 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:45.902135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:45.904424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:45.910851 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.911372 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.911859 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.912553 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:45.913005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:45.913436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:45.936242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lazy-loading 'flavor' on Instance uuid 6f28e21f-660b-450f-9880-aa1b2b5a6e29 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:23:46.057471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4d5473de-b62e-4573-924a-78f11916a449 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/action" status: 200 len: 32 microversion: 2.1 time: 0.159343 Aug 31 00:23:46.058166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 322/642] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:23:45 2022] POST /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:23:46.067497 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:46.068758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:46.075570 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:46.076088 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:46.076626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:46.077425 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:46.078002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:46.078424 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:46.287587 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:46.296055 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-22fa175d-56d3-48e2-bf3a-2a787aecf522 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.232401 Aug 31 00:23:46.296620 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 321/643] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:46 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:46.721052 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:46.721792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:46.728426 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:46.728898 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:46.729331 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:46.730043 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:46.730488 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:46.731002 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:46.867103 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:46.875039 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6e1b24ff-ea42-45bd-9f0e-7abcb9a4f181 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.158267 Aug 31 00:23:46.875604 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 323/644] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:46 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:47.318873 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:47.319511 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:47.326369 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:47.328195 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:47.328637 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:47.329326 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:47.329779 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:47.330233 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:47.469698 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:47.478850 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-32b3261d-c36d-4344-81c3-12f8cf9fb11e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.164429 Aug 31 00:23:47.479412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 322/645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:47 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:47.897059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:47.897660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:47.904181 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:47.904657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:47.905090 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:47.905773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:47.906253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:47.906677 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:48.034844 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:48.042679 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d1681406-509a-42dc-8434-4facada6523a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.150065 Aug 31 00:23:48.043241 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 324/646] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:47 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:48.500257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:48.500876 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:48.507316 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:48.507799 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:48.508241 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:48.508926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:48.509382 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:48.509804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:48.633428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:48.641599 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8fab9f51-e61a-43a2-b385-7a59fb57d95c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.145237 Aug 31 00:23:48.642263 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 323/647] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:48 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:49.064418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:49.065018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:49.071972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:49.072445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:49.072873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:49.073548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:49.074112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:49.074535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:49.200055 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:49.207629 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3e3d6200-87a7-421e-b82b-35a8f016322b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.147042 Aug 31 00:23:49.208196 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 325/648] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:49 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:49.662435 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:49.662983 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:49.669586 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:49.670107 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:49.670537 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:49.671211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:49.671654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:49.672069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:49.803082 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:49.812026 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-72bedfb1-469c-4f0c-a7e4-51d05584f182 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.153533 Aug 31 00:23:49.812595 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 324/649] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:49 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:50.229569 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:50.230250 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:50.236692 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.237169 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.237605 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.238316 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.238769 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.239200 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.369703 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:50.377494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-dba76993-9a08-4deb-9b01-aad76246d77d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1677 microversion: 2.1 time: 0.151781 Aug 31 00:23:50.378091 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 326/650] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:50 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:50.833003 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:50.833654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:50.840761 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.841242 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.841674 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.842388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:50.842843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:50.843263 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:50.968525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:50.977029 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4ad03b2e-fd14-4326-8157-44a154f0ba09 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.147962 Aug 31 00:23:50.977596 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 325/651] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:50 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:51.398453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:51.399064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:51.405510 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.406033 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.406473 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.407163 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.407619 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.408045 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.538713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:51.546617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d1b905c8-bb1c-47db-806c-855fa1607e26 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1654 microversion: 2.1 time: 0.152010 Aug 31 00:23:51.547183 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 327/652] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:51 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:51.567373 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7bf5ae76-b226-48cc-a877-2ece48a16231 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:23:51.573290 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7bf5ae76-b226-48cc-a877-2ece48a16231 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.573761 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7bf5ae76-b226-48cc-a877-2ece48a16231 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.574222 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7bf5ae76-b226-48cc-a877-2ece48a16231 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.595398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7bf5ae76-b226-48cc-a877-2ece48a16231 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Going to try to start instance {{(pid=132200) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 00:23:51.637927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7bf5ae76-b226-48cc-a877-2ece48a16231 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/action" status: 202 len: 0 microversion: 2.1 time: 0.074166 Aug 31 00:23:51.638504 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 326/653] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:23:51 2022] POST /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:23:51.646726 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:51.647337 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:51.654888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.657019 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.657479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.658259 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:51.658710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:51.659137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:51.792393 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:51.800995 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0bea36ab-576e-452c-8804-0c6baa0f3a30 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1663 microversion: 2.1 time: 0.158129 Aug 31 00:23:51.801802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 328/654] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:51 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:51.999793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:52.000495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:52.006765 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:52.007249 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:52.007688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:52.008376 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:52.008825 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:52.009250 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:52.136289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:52.144455 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-473f40c3-3dfa-497a-a7c5-e964d777fe96 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.149421 Aug 31 00:23:52.145019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 327/655] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:51 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:52.822481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:52.823075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:52.829522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:52.830113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:52.830540 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:52.831218 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:52.831664 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:52.832082 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:52.966480 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:52.974854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5edf937a-0828-4204-96cc-873016482060 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1663 microversion: 2.1 time: 0.155963 Aug 31 00:23:52.975392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 329/656] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:52 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:53.166829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:53.167438 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:53.174198 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:53.174679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:53.175112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:53.175798 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:53.176253 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:53.176675 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:53.305409 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:53.313661 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-079e38a7-dccf-49dc-a342-2d4aeaba4d33 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.150696 Aug 31 00:23:53.314262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 328/657] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:53 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:53.995628 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:53.996234 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:54.002703 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:54.003184 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:54.003614 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:54.004294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:54.004773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:54.005199 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:54.131325 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:54.138974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-fb3115d7-7869-4cd6-9de5-bb0ba7b2fe31 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1663 microversion: 2.1 time: 0.147217 Aug 31 00:23:54.139558 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 330/658] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:53 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1663 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:54.333704 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:54.334364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:54.340734 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:54.341212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:54.341640 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:54.342359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:54.342811 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:54.343227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:54.468370 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:54.477342 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f44638a3-f3f4-470c-aecc-f32a90830fe0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.147574 Aug 31 00:23:54.477932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 329/659] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:54 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:55.159953 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:55.160563 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:55.167049 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:55.167549 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:55.167980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.168657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:55.169105 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:55.169782 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.294579 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:55.302238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b1b6e8bb-19d1-49b3-863d-98f3193c5c1c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1663 microversion: 2.1 time: 0.146108 Aug 31 00:23:55.302800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 331/660] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:55 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1663 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:55.498868 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:55.499466 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:55.506490 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:55.506965 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:55.507401 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.508066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:55.508511 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:55.508926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:55.526784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:55.639563 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:55.647822 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-467a9374-cb53-4913-b839-278d87287e20 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.152756 Aug 31 00:23:55.648387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 330/661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:55 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:56.323523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:56.324085 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:56.330776 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:56.331263 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:56.331713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:56.332406 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:56.332895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:56.333866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:56.462239 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:56.470006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5e94fe2b-537f-4935-a153-210b221d130a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1663 microversion: 2.1 time: 0.150409 Aug 31 00:23:56.470569 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 332/662] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:56 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:56.668420 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:56.668946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:56.675803 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:56.676283 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:56.676717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:56.677406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:56.677871 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:56.678310 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:56.812419 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:56.822513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4cbf8de9-e7bd-4e2e-a0c2-ca0c539eda26 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.157938 Aug 31 00:23:56.823077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 331/663] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:56 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:57.492302 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:57.492900 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:57.495315 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=44 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:57.500431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.500906 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.501336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.502044 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.502488 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.502905 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.507015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:57.629833 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:57.637523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-926b924e-7cb5-46c8-9a0a-686ac6685f7a tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1667 microversion: 2.1 time: 0.149635 Aug 31 00:23:57.638214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 333/664] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:57 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:57.844268 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:57.844830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:57.847187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=46 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:57.853069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.853553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.854031 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.854724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:57.855177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:57.855603 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:57.986178 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:57.994495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-98baec85-4153-451c-9b4d-c05b03fe0d05 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.154176 Aug 31 00:23:57.995070 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 332/665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:57 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:23:59.015550 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:23:59.016164 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:23:59.022652 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:59.023138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:59.023577 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:59.024296 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:23:59.024751 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:23:59.025178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:23:59.155907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:23:59.164660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-38da5ec2-3ea8-46e6-99d2-7b48f9f23443 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.153010 Aug 31 00:23:59.165222 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 334/666] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:23:59 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:00.186261 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:00.186906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:00.194809 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:00.195287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:00.195721 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:00.196404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:00.196857 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:00.197286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:00.319731 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:00.327929 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bc7e6f2e-3189-4571-966e-514d7ba79d2c tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.145540 Aug 31 00:24:00.328492 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 333/667] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:00 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:01.348793 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:01.349397 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:01.355871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:01.356342 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:01.356767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:01.357444 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:01.357914 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:01.358336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:01.489761 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:01.498562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-96bf66a7-940a-4bc4-a664-a385ca1cc636 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.153542 Aug 31 00:24:01.499128 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 335/668] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:01 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:02.520581 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:02.521100 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:02.527988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:02.528456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:02.528886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:02.529553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:02.530028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:02.530448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:02.660930 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:02.669631 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ee20eb76-bd1c-454e-b12b-4c22c6b8f98f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.152579 Aug 31 00:24:02.670149 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 334/669] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:02 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:03.904093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:03.904706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:03.910800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:03.911285 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:03.911722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:03.912409 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:03.913511 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:03.913957 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:04.045635 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:04.053816 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cae720b8-cb5f-4aa4-88d4-497c1d726aed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.367837 Aug 31 00:24:04.054581 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 336/670] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:03 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:04.472696 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:04.473190 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:04.480315 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:04.480794 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:04.481225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:04.481947 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:04.482402 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:04.482822 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:04.562953 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lazy-loading 'services' on Instance uuid d5ae81fb-ca61-416f-874d-f1cd8dbec710 {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:04.634155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-cb212ab9-8c4f-41cd-b5fb-0fd03f0bded8 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710/os-volume_attachments/b7532742-74c9-4e96-9ec8-66a7ece6b991" status: 202 len: 0 microversion: 2.1 time: 0.165188 Aug 31 00:24:04.634735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 335/671] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:24:04 2022] DELETE /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710/os-volume_attachments/b7532742-74c9-4e96-9ec8-66a7ece6b991 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:24:05.076684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:05.077363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:05.085642 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:05.086171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:05.086613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:05.087307 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:05.087758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:05.088183 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:05.216129 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:05.224234 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5fec5e3d-b3e6-4342-80b0-5428bd8faddc tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.152422 Aug 31 00:24:05.224811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 337/672] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:05 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:06.246594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:06.247323 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:06.254202 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:06.254603 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:06.255049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:06.255723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:06.256175 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:06.257106 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:06.499805 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:06.508586 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d4360c20-eacc-4f97-a998-b59b746a5edd tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.266963 Aug 31 00:24:06.509081 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 336/673] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:06 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:07.313101 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-65bfe8b9-d30b-4777-a46b-d45adb06bdd7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:07.313588 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-65bfe8b9-d30b-4777-a46b-d45adb06bdd7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:07.320051 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-65bfe8b9-d30b-4777-a46b-d45adb06bdd7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.320552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-65bfe8b9-d30b-4777-a46b-d45adb06bdd7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.321074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-65bfe8b9-d30b-4777-a46b-d45adb06bdd7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.321824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-65bfe8b9-d30b-4777-a46b-d45adb06bdd7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.322317 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-65bfe8b9-d30b-4777-a46b-d45adb06bdd7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.322756 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-65bfe8b9-d30b-4777-a46b-d45adb06bdd7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.354081 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-65bfe8b9-d30b-4777-a46b-d45adb06bdd7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments/136d7549-743e-43a4-ac5a-548ff7341d40" status: 200 len: 194 microversion: 2.20 time: 0.145900 Aug 31 00:24:07.354641 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 338/674] 10.222.0.49 () {60 vars in 1454 bytes} [Wed Aug 31 00:24:07 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments/136d7549-743e-43a4-ac5a-548ff7341d40 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:24:07.420080 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:07.420602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:07.427016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.427493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.427926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.429140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.429592 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.430047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.509978 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lazy-loading 'services' on Instance uuid 28862807-4ab6-4376-9e01-b40cd4e4483a {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:07.528406 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:07.529025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:07.534957 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.535450 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.535892 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.536591 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.537049 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.537536 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.580487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-59313168-5d96-444e-8956-fbd744a0f1d4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments/136d7549-743e-43a4-ac5a-548ff7341d40" status: 202 len: 0 microversion: 2.20 time: 0.164465 Aug 31 00:24:07.581131 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 337/675] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 31 00:24:07 2022] DELETE /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments/136d7549-743e-43a4-ac5a-548ff7341d40 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:24:07.589955 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5b705e44-21ec-4768-9a1c-cc4560772292 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:07.592303 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5b705e44-21ec-4768-9a1c-cc4560772292 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:07.598849 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b705e44-21ec-4768-9a1c-cc4560772292 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.599327 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b705e44-21ec-4768-9a1c-cc4560772292 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.599763 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b705e44-21ec-4768-9a1c-cc4560772292 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.600453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b705e44-21ec-4768-9a1c-cc4560772292 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.600902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b705e44-21ec-4768-9a1c-cc4560772292 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.601322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b705e44-21ec-4768-9a1c-cc4560772292 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.632133 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5b705e44-21ec-4768-9a1c-cc4560772292 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045825 Aug 31 00:24:07.632703 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 338/676] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 31 00:24:07 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:24:07.667764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:07.676184 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-33094a38-433b-439b-a110-14adafb9dc87 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.151627 Aug 31 00:24:07.676745 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 339/677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:07 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:07.859363 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:07.859860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:07.866554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.867046 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.867484 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.868174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.868632 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.869057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.893278 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:24:07.966585 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9099ddac-e474-43a2-b086-578f2859aeb4 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 204 len: 0 microversion: 2.1 time: 0.110784 Aug 31 00:24:07.967156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 339/678] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:24:07 2022] DELETE /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:24:07.976137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:07.976968 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:07.982890 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.983367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.983800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:07.984481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:07.984928 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:07.985348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.114970 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:08.123701 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c66da0cb-089e-43bc-b171-f88d9da6a663 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1560 microversion: 2.1 time: 0.152286 Aug 31 00:24:08.124264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 340/679] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:07 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:08.645229 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ae67c043-2726-45cf-b186-c4938f5c23d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:08.648061 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ae67c043-2726-45cf-b186-c4938f5c23d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:08.654418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae67c043-2726-45cf-b186-c4938f5c23d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.654891 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae67c043-2726-45cf-b186-c4938f5c23d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.655317 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae67c043-2726-45cf-b186-c4938f5c23d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.655994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae67c043-2726-45cf-b186-c4938f5c23d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.656434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae67c043-2726-45cf-b186-c4938f5c23d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.656848 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae67c043-2726-45cf-b186-c4938f5c23d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.687212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ae67c043-2726-45cf-b186-c4938f5c23d5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046450 Aug 31 00:24:08.687757 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 340/680] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 31 00:24:08 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:24:08.696884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:08.697501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:08.704204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.704686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.705156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.705871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:08.706332 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:08.706760 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:08.888207 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:08.896429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1d2685df-6b5c-4df9-9b25-6f9512400d64 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.203815 Aug 31 00:24:08.897606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 341/681] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:08 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:09.144515 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:09.145128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:09.151232 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.151653 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.152087 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.152772 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.153222 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.153643 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.282312 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:09.290542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-33dff788-7bab-4485-ac08-62d3e5a181e0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1514 microversion: 2.1 time: 0.149922 Aug 31 00:24:09.291105 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 341/682] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:09 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:09.699624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a1e4a380-98f2-4d9c-aa2a-87151a4bbd42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:09.701879 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a1e4a380-98f2-4d9c-aa2a-87151a4bbd42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:09.708366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a1e4a380-98f2-4d9c-aa2a-87151a4bbd42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.708849 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a1e4a380-98f2-4d9c-aa2a-87151a4bbd42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.709828 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a1e4a380-98f2-4d9c-aa2a-87151a4bbd42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.710546 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a1e4a380-98f2-4d9c-aa2a-87151a4bbd42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.711000 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a1e4a380-98f2-4d9c-aa2a-87151a4bbd42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.711429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a1e4a380-98f2-4d9c-aa2a-87151a4bbd42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.741367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a1e4a380-98f2-4d9c-aa2a-87151a4bbd42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045739 Aug 31 00:24:09.741928 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 342/683] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 31 00:24:09 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:24:09.918659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:09.919551 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:09.926124 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.926609 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.927047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:09.927735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:09.928187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:09.928612 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:10.058532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:10.066881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1ad3d263-8bc6-435d-89e1-fd7413883b2e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.152101 Aug 31 00:24:10.067433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 342/684] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:09 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:10.312527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:10.313070 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:10.319615 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:10.320088 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:10.320522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:10.321205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:10.321648 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:10.322090 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:10.453415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:10.461147 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ffe4fee9-f6c6-4270-a6e9-08ddb1009920 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1514 microversion: 2.1 time: 0.152649 Aug 31 00:24:10.461725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 343/685] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:10 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:10.753257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1182708c-8901-42ce-9ac0-4faebe117474 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:10.755575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1182708c-8901-42ce-9ac0-4faebe117474 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:10.762306 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1182708c-8901-42ce-9ac0-4faebe117474 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:10.762792 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1182708c-8901-42ce-9ac0-4faebe117474 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:10.763236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1182708c-8901-42ce-9ac0-4faebe117474 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:10.763917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1182708c-8901-42ce-9ac0-4faebe117474 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:10.764367 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1182708c-8901-42ce-9ac0-4faebe117474 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:10.764790 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1182708c-8901-42ce-9ac0-4faebe117474 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:10.796245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1182708c-8901-42ce-9ac0-4faebe117474 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046875 Aug 31 00:24:10.796991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 343/686] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 31 00:24:10 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:24:11.088519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:11.089040 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:11.095510 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.095990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.096423 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.097107 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.097558 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.098020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.231283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:11.239502 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-000d8d62-0175-43fb-a1a3-5f1f55ace2ec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.154937 Aug 31 00:24:11.240067 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 344/687] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:11 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:11.482444 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:11.483053 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:11.489435 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.489934 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.490364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.491042 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.491513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.491928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.496071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:11.619973 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:11.627684 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c67a2219-647e-4d9c-a6bc-d4f74d18949a tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1514 microversion: 2.1 time: 0.149156 Aug 31 00:24:11.628236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 344/688] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:11 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:11.808633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-14acfe2d-468f-4ce7-a1a7-558ebc974428 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:11.810784 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-14acfe2d-468f-4ce7-a1a7-558ebc974428 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:11.816789 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14acfe2d-468f-4ce7-a1a7-558ebc974428 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.817266 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14acfe2d-468f-4ce7-a1a7-558ebc974428 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.817699 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14acfe2d-468f-4ce7-a1a7-558ebc974428 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.818940 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14acfe2d-468f-4ce7-a1a7-558ebc974428 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:11.819407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14acfe2d-468f-4ce7-a1a7-558ebc974428 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:11.819836 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-14acfe2d-468f-4ce7-a1a7-558ebc974428 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:11.848849 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-14acfe2d-468f-4ce7-a1a7-558ebc974428 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044258 Aug 31 00:24:11.849394 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 345/689] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 31 00:24:11 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:24:12.262476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:12.263132 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:12.265385 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:24:12.265531 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Wed Aug 31 00:24:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 (ip 10.222.0.49) !!! Aug 31 00:24:12.271565 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.272039 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.272469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.273152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.273596 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.274050 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.402544 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:12.411741 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a37e87fb-e38c-4549-8a4c-9c0f09648d35 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.153076 Aug 31 00:24:12.412881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 345/690] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:12 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:12.649032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:12.649562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:12.655941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.656410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.656841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.657521 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.657995 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.658414 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.785195 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:12.793058 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-473deb4c-5e5d-4998-a243-c5c1fcd6419b tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1514 microversion: 2.1 time: 0.148476 Aug 31 00:24:12.793621 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 346/691] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:12 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:12.860716 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e805952d-01dd-433c-b687-63172b647e41 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:12.862904 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e805952d-01dd-433c-b687-63172b647e41 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:12.869957 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e805952d-01dd-433c-b687-63172b647e41 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.870438 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e805952d-01dd-433c-b687-63172b647e41 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.870870 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e805952d-01dd-433c-b687-63172b647e41 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.871715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e805952d-01dd-433c-b687-63172b647e41 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:12.872038 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e805952d-01dd-433c-b687-63172b647e41 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:12.872458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e805952d-01dd-433c-b687-63172b647e41 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:12.905641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e805952d-01dd-433c-b687-63172b647e41 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048834 Aug 31 00:24:12.906152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 346/692] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 31 00:24:12 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:24:13.434605 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:13.435220 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:13.441457 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.441967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.442400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.443127 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.443573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.444132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.583791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:13.592615 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-256e6e55-9288-4f21-bafa-0742517cfd11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1735 microversion: 2.1 time: 0.162734 Aug 31 00:24:13.593647 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 347/693] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:13 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:13.703040 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-4c46b697-a1dd-456b-b5be-125d7a6fddd2 req-c5e5c1e4-a54f-47cb-9016-e81e848b581e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ae81fb-ca61-416f-874d-f1cd8dbec710", "name": "network-vif-deleted", "tag": "b8968ff6-2d32-4404-935f-0921cc1806db"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:13.712205 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-4c46b697-a1dd-456b-b5be-125d7a6fddd2 req-c5e5c1e4-a54f-47cb-9016-e81e848b581e service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.712677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-4c46b697-a1dd-456b-b5be-125d7a6fddd2 req-c5e5c1e4-a54f-47cb-9016-e81e848b581e service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.713103 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-4c46b697-a1dd-456b-b5be-125d7a6fddd2 req-c5e5c1e4-a54f-47cb-9016-e81e848b581e service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.723784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-4c46b697-a1dd-456b-b5be-125d7a6fddd2 req-c5e5c1e4-a54f-47cb-9016-e81e848b581e service nova] Creating event network-vif-deleted:b8968ff6-2d32-4404-935f-0921cc1806db for instance d5ae81fb-ca61-416f-874d-f1cd8dbec710 on hv-cinder-85220 Aug 31 00:24:13.728535 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-4c46b697-a1dd-456b-b5be-125d7a6fddd2 req-c5e5c1e4-a54f-47cb-9016-e81e848b581e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029131 Aug 31 00:24:13.729103 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 347/694] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:13.814504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:13.815039 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:13.821483 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.822004 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.822435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.823140 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.823584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.824002 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.885261 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:13.893011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-557398e9-ac48-4bfb-88ef-b61332667c8d tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1472 microversion: 2.1 time: 0.082468 Aug 31 00:24:13.893576 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 348/695] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:13 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:13.919586 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fec185d3-5097-42d6-9985-f43f5c59154a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:13.921827 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fec185d3-5097-42d6-9985-f43f5c59154a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:13.928777 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fec185d3-5097-42d6-9985-f43f5c59154a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.929257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fec185d3-5097-42d6-9985-f43f5c59154a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.929727 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fec185d3-5097-42d6-9985-f43f5c59154a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.930445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fec185d3-5097-42d6-9985-f43f5c59154a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:13.930907 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fec185d3-5097-42d6-9985-f43f5c59154a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:13.931320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fec185d3-5097-42d6-9985-f43f5c59154a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:13.961465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fec185d3-5097-42d6-9985-f43f5c59154a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046908 Aug 31 00:24:13.962049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 348/696] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 31 00:24:13 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:24:14.615651 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:14.616266 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:14.622133 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.622620 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.623073 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.623770 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.624225 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.624652 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.761619 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:14.765084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:14.771079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9c9481fc-5d14-4170-af7e-043674a6b788 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1715 microversion: 2.1 time: 0.161170 Aug 31 00:24:14.785868 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 349/697] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:14 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:14.833179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:14.833815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:14.840565 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.841157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.841715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.842532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.843529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.843529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.914512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:14.915123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:14.922564 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.923052 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.923491 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.924184 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.924779 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.925214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.945217 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] HTTP exception thrown: Cannot 'detach_volume' instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 while it is in vm_state rescued Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Request method failure captured: Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: DELETE /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments/cdc8ae1a-8320-4962-8fa1-36205b830373 HTTP/1.1 Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj1A1kG2LdTorCDgkkVutZAVVGIaO4-7cOAUPDdewrt9JNvRFxPRTVO1_BKlI-5brYoD4Aac_PF8C4vrfca77Oa_HK8LAwmhL5pfRxTAmp-Z5nlkUqMCh13xrTQokK16igBIB5IBYPzSV0HilEnWbVpSU-HBpCeo0mcAS6-BzyFzOs Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:24:14.947109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: c924dfe7e9c941f9b7110c1a440633dc Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:24:14.948771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Cannot 'detach_volume' instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 while it is in vm_state rescued Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'server_id': '6f28e21f-660b-450f-9880-aa1b2b5a6e29', 'id': 'cdc8ae1a-8320-4962-8fa1-36205b830373'} Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:24:14.949525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 while it is in vm_state rescued Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 while it is in vm_state rescued Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:14.951000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Returning 409 to user: Cannot 'detach_volume' instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 while it is in vm_state rescued {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:24:14.952832 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-814711b9-21b3-4eb2-8623-04a73dcf5d55 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments/cdc8ae1a-8320-4962-8fa1-36205b830373" status: 409 len: 152 microversion: 2.1 time: 0.119455 Aug 31 00:24:14.952832 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 349/698] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:24:14 2022] DELETE /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments/cdc8ae1a-8320-4962-8fa1-36205b830373 => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:24:14.956950 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3d19046e-75e3-445e-a0f4-951351bec76b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:14.957690 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3d19046e-75e3-445e-a0f4-951351bec76b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:14.964597 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d19046e-75e3-445e-a0f4-951351bec76b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.965078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d19046e-75e3-445e-a0f4-951351bec76b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.965514 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d19046e-75e3-445e-a0f4-951351bec76b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.966233 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d19046e-75e3-445e-a0f4-951351bec76b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.966682 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d19046e-75e3-445e-a0f4-951351bec76b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.968657 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d19046e-75e3-445e-a0f4-951351bec76b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.974595 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:14.975597 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:14.976032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:14.976479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lazy-loading 'fault' on Instance uuid d5ae81fb-ca61-416f-874d-f1cd8dbec710 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:15.016136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.025172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5cfbc260-ebe2-45e3-a2f4-63a23bb22eeb tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1309 microversion: 2.1 time: 0.115318 Aug 31 00:24:15.025741 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 350/699] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:14 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:15.030870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-25634985-112d-41a6-be33-02485d69240e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:15.032833 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-25634985-112d-41a6-be33-02485d69240e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:15.039969 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-25634985-112d-41a6-be33-02485d69240e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.040486 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-25634985-112d-41a6-be33-02485d69240e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.040865 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3d19046e-75e3-445e-a0f4-951351bec76b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "POST /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/action" status: 202 len: 0 microversion: 2.1 time: 0.087277 Aug 31 00:24:15.040974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-25634985-112d-41a6-be33-02485d69240e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.041609 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-25634985-112d-41a6-be33-02485d69240e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.041748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 350/700] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:24:14 2022] POST /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:24:15.042094 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-25634985-112d-41a6-be33-02485d69240e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.042517 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-25634985-112d-41a6-be33-02485d69240e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.050333 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:15.051093 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:15.057255 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.057747 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.058218 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.059354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.059354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.059764 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.071408 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-25634985-112d-41a6-be33-02485d69240e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044631 Aug 31 00:24:15.071974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 351/701] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 31 00:24:15 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:15.135603 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:15.136096 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:15.142059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.142542 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.142974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.143663 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.144111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.144533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.170801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:24:15.189367 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.198103 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3f8b7dec-30a4-4d32-9164-9f3eb0877215 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1723 microversion: 2.1 time: 0.151621 Aug 31 00:24:15.198892 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 351/702] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:15 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:15.258657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b56b0881-0e16-425b-aa96-da2ac5c0943b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 204 len: 0 microversion: 2.20 time: 0.126367 Aug 31 00:24:15.259439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 352/703] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 31 00:24:15 2022] DELETE /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 00:24:15.267656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:15.268268 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:15.274904 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.275386 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.275833 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.276516 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:15.276970 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:15.277397 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:15.421097 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.429322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.430802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:15.431956 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1fae0791-eba9-4e7f-a8de-18f2bd46ff9a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.168201 Aug 31 00:24:15.432517 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 352/704] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:15 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:16.047897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:16.048592 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:16.055873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.056343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.056772 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.057444 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.057904 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.058322 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.090028 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.090499 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.090935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.091373 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lazy-loading 'fault' on Instance uuid d5ae81fb-ca61-416f-874d-f1cd8dbec710 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:16.132403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e57290be8d341db824952c83703b118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dbc22f8641481291939540b00e0225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.139959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5e418d9a-6b2b-400f-abaa-8cc77d01ace0 tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 200 len: 1309 microversion: 2.1 time: 0.096599 Aug 31 00:24:16.140517 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 353/705] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:16 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:16.219808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:16.220418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:16.227362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.227844 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.228280 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.228987 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.229424 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.229864 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.358629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.367438 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-adfc4512-b0d2-4926-9c09-9abb26143524 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1723 microversion: 2.1 time: 0.151434 Aug 31 00:24:16.368009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 353/706] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:16 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:16.455093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:16.455632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:16.462126 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.462608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.463041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.463723 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:16.464174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:16.464594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:16.602765 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.610908 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.612363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:16.613553 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-24cd008a-7a67-403f-96e7-9667b6f79399 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.162346 Aug 31 00:24:16.614141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 354/707] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:16 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:17.160557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:17.161088 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] [instance: d5ae81fb-ca61-416f-874d-f1cd8dbec710] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:17.167105 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.167585 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.168022 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.169073 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.169423 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.169921 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.183697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] HTTP exception thrown: Instance d5ae81fb-ca61-416f-874d-f1cd8dbec710 could not be found. Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Request method failure captured: Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 HTTP/1.1 Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqlabWuovwhe8qfB39fIwDHH6ElVHmcgwFTa269LR09F3q5FklGhY7PvyPkzuwcNV66Vdv5gaARXnHbliigV57yKtMebrMiAmB_qNbm5qlxlTMtDU5dBShgv25rtHhHgS_SU2nGqB-JAmoeljlLQmXYYAmc_2vb-UQzx3p8A2z9gqIw Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 80dbc22f8641481291939540b00e0225 Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1992499973 Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:24:17.185308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/80dbc22f8641481291939540b00e0225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80dbc22f8641481291939540b00e0225"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80dbc22f8641481291939540b00e0225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_80dbc22f8641481291939540b00e0225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-VolumesSnapshotTestJSON-1992499973 Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 80dbc22f8641481291939540b00e0225 Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1992499973 Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-VolumesSnapshotTestJSON-1992499973-project Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 4e57290be8d341db824952c83703b118 Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-VolumesSnapshotTestJSON-1992499973-project Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance d5ae81fb-ca61-416f-874d-f1cd8dbec710 could not be found. Aug 31 00:24:17.186893 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': 'd5ae81fb-ca61-416f-874d-f1cd8dbec710'} Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5ae81fb-ca61-416f-874d-f1cd8dbec710 could not be found. Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:24:17.187819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5ae81fb-ca61-416f-874d-f1cd8dbec710 could not be found. Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5ae81fb-ca61-416f-874d-f1cd8dbec710 could not be found. Aug 31 00:24:17.189348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:17.190843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] Returning 404 to user: Instance d5ae81fb-ca61-416f-874d-f1cd8dbec710 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:24:17.190843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-20c278ef-ced3-4a09-b54b-82e6afc043cd tempest-VolumesSnapshotTestJSON-1992499973 tempest-VolumesSnapshotTestJSON-1992499973-project] 10.222.0.49 "GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710" status: 404 len: 111 microversion: 2.1 time: 0.030069 Aug 31 00:24:17.190843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 354/708] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:17 2022] GET /compute/v2.1/servers/d5ae81fb-ca61-416f-874d-f1cd8dbec710 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:17.388144 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:17.388758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:17.395439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.395931 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.409774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.409774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.409774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.409774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.637377 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:17.638551 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:17.641279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:17.645270 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.645928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.646677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.647576 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:17.648195 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:17.648849 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:17.657812 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-062a2235-7cd5-4783-9f21-e65d58e038fa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1723 microversion: 2.1 time: 0.273474 Aug 31 00:24:17.658686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 355/709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:17 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:17.918730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:17.927237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:17.928691 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:17.929872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c59cf274-6423-4a06-97f1-f4d15dcc65ce tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1722 microversion: 2.20 time: 0.297091 Aug 31 00:24:17.930436 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 355/710] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:17 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:18.418051 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-9c0665fe-2757-42a9-b5e0-2a295a72a3d2 req-4a19a18f-3f53-4a32-8d01-d9d8183ade30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28862807-4ab6-4376-9e01-b40cd4e4483a", "name": "network-vif-deleted", "tag": "07e1f3ff-ed06-4bbc-af49-616e3dd80848"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:18.428519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-9c0665fe-2757-42a9-b5e0-2a295a72a3d2 req-4a19a18f-3f53-4a32-8d01-d9d8183ade30 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.428972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-9c0665fe-2757-42a9-b5e0-2a295a72a3d2 req-4a19a18f-3f53-4a32-8d01-d9d8183ade30 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.429436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-9c0665fe-2757-42a9-b5e0-2a295a72a3d2 req-4a19a18f-3f53-4a32-8d01-d9d8183ade30 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.440632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-9c0665fe-2757-42a9-b5e0-2a295a72a3d2 req-4a19a18f-3f53-4a32-8d01-d9d8183ade30 service nova] Creating event network-vif-deleted:07e1f3ff-ed06-4bbc-af49-616e3dd80848 for instance 28862807-4ab6-4376-9e01-b40cd4e4483a on hv-cinder-85220 Aug 31 00:24:18.446007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-9c0665fe-2757-42a9-b5e0-2a295a72a3d2 req-4a19a18f-3f53-4a32-8d01-d9d8183ade30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031695 Aug 31 00:24:18.446606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 356/711] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:18.681622 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:18.682274 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:18.691056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.691656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.692122 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.693024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.694084 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.694682 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.851665 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:18.866659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-accde1b8-a7d3-4167-9dc4-0da784277cf0 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1723 microversion: 2.1 time: 0.190274 Aug 31 00:24:18.868188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 356/712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:18 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:18.952679 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:18.953375 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:18.960896 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.961468 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.962017 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:18.962905 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:18.963338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:18.963852 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:19.027894 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:19.036450 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:19.038703 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:19.039883 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ca4d067c-e228-4c66-b97c-a07188a5c751 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1654 microversion: 2.20 time: 0.091679 Aug 31 00:24:19.040449 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 357/713] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:18 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1654 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:19.888875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:19.889619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:19.897391 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:19.897902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:19.898346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:19.899056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:19.899518 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:19.899945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.029808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:20.038178 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-92888653-bb58-446a-a5d5-e279a23feeed tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1723 microversion: 2.1 time: 0.153345 Aug 31 00:24:20.038743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 357/714] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:19 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:20.063956 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:20.064572 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:20.073520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.074239 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.074854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.075574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:20.076026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:20.076642 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:20.142183 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:20.151365 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:20.152839 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:20.154072 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-948865a3-fa86-4602-91d2-89385515dff4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1654 microversion: 2.20 time: 0.094036 Aug 31 00:24:20.154642 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 358/715] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:20 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1654 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:21.059520 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:21.060034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:21.066447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.066923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.067349 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.068642 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.069095 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.069515 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.179930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:21.180688 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:21.188592 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.189076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.189537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.190257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:21.190716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:21.191136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:21.216741 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:21.225034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-20038e71-d080-4679-9c1b-2eaa215093d9 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1723 microversion: 2.1 time: 0.169393 Aug 31 00:24:21.225601 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 358/716] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:21 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:21.257262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:21.265552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:21.267015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:21.268165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6d7e802b-94f2-49cc-bcb2-b3adec419feb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1654 microversion: 2.20 time: 0.094119 Aug 31 00:24:21.268730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 359/717] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:21 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1654 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:22.246521 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:22.247128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:22.253518 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.254047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.254495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.255182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.256174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.256602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.291246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:22.291864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:22.299200 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.299774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.300319 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.301121 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:22.301687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:22.302253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:22.365739 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:22.373935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:22.375384 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:22.376524 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-26383cb0-660c-4a3f-97d1-d5766b98376f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1365 microversion: 2.20 time: 0.089213 Aug 31 00:24:22.377281 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 360/718] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:22 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:22.383702 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:22.392191 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2cabc588-0ab5-4a35-894d-555fd93fa3e1 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1723 microversion: 2.1 time: 0.149501 Aug 31 00:24:22.392757 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 359/719] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:22 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:23.399611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:23.400219 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:23.406655 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.407140 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.407911 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.408608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.409063 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.409489 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.412564 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:23.413163 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:23.419839 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.420311 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.420740 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.421416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.421883 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.422302 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.440783 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.441270 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.441712 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.442192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lazy-loading 'fault' on Instance uuid 28862807-4ab6-4376-9e01-b40cd4e4483a {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:23.482940 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:23.491893 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:23.493371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:23.494557 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e8ca2ca4-fe73-4165-8890-28370ad0ed93 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 200 len: 1370 microversion: 2.20 time: 0.098922 Aug 31 00:24:23.495115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 361/720] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:23 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:23.554986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:23.563276 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fb81f501-4e8d-4288-b81c-e5654c99a72f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1729 microversion: 2.1 time: 0.154438 Aug 31 00:24:23.563836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 360/721] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:23 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:23.584038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-31baa1cd-f128-409c-9267-cb6ba7844208 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:23.584770 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-31baa1cd-f128-409c-9267-cb6ba7844208 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:23.591498 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31baa1cd-f128-409c-9267-cb6ba7844208 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.592169 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31baa1cd-f128-409c-9267-cb6ba7844208 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.592681 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31baa1cd-f128-409c-9267-cb6ba7844208 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.593679 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31baa1cd-f128-409c-9267-cb6ba7844208 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:23.594167 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31baa1cd-f128-409c-9267-cb6ba7844208 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:23.594599 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-31baa1cd-f128-409c-9267-cb6ba7844208 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:23.705716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-31baa1cd-f128-409c-9267-cb6ba7844208 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125865 Aug 31 00:24:23.706647 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 362/722] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 31 00:24:23 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:24.246415 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-48468824"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:24.246908 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:24.252937 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.253484 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.254022 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.254778 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.255830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.256313 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.275557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:24.405645 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.network.security_group_api [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Removing security group 9e290543-0451-4eb0-8b0d-469b4069cc75 from port fa6d8697-5c97-4a6e-a066-a4a09dee4e61 Aug 31 00:24:24.518795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:24.519403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:24.526385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.527076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.527519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.528210 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.528663 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.529088 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.542907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] HTTP exception thrown: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Request method failure captured: Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a HTTP/1.1 Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqj4-HDPR070jRUYhtloLA-yUS-IDnMrcsHzSq26iBS-LjGa_SYH_Dfeg_wIFAG6OcD_ISxXkeoDX136VrN6SnFc0p5OvfuoSBhgxqnrnXNyHrbCVbwVUuZRR_yuIb0j5WR5qRcELG4CH7zGYsALd6l4SdQmHaCvC9KTqNVrOxTzQMk Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:24:24.544845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: a76438b57a2140cca853e0e71fb28f64 Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:24:24.546345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '28862807-4ab6-4376-9e01-b40cd4e4483a'} Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:24:24.547360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:24:24.549024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:24.551392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Returning 404 to user: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:24:24.551392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b255149d-d85c-44d8-b2a4-e8df849c299d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 404 len: 111 microversion: 2.20 time: 0.032130 Aug 31 00:24:24.551392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 363/723] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:24 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 00:24:24.555046 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-918a01b2-087c-4d80-8c87-f8d9d728821e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '.version_select at 0x7fcd6bb6faf0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:24.586594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-918a01b2-087c-4d80-8c87-f8d9d728821e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-728332430" status: 204 len: 0 microversion: 2.20 time: 0.034873 Aug 31 00:24:24.590373 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 364/724] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 31 00:24:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-728332430 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 00:24:24.623321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-591720dd-cb00-4cf8-86b3-039ca38b7cd5 req-cdfcc006-1e5f-4132-8594-cec48e093181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f28e21f-660b-450f-9880-aa1b2b5a6e29", "tag": "49a7aa6e-4699-4230-9b6f-018c8e0162ed"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:24.640501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-591720dd-cb00-4cf8-86b3-039ca38b7cd5 req-cdfcc006-1e5f-4132-8594-cec48e093181 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.642511 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-591720dd-cb00-4cf8-86b3-039ca38b7cd5 req-cdfcc006-1e5f-4132-8594-cec48e093181 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.643321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-591720dd-cb00-4cf8-86b3-039ca38b7cd5 req-cdfcc006-1e5f-4132-8594-cec48e093181 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.661430 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-591720dd-cb00-4cf8-86b3-039ca38b7cd5 req-cdfcc006-1e5f-4132-8594-cec48e093181 service nova] Creating event network-changed:49a7aa6e-4699-4230-9b6f-018c8e0162ed for instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 on hv-cinder-85220 Aug 31 00:24:24.668360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-591720dd-cb00-4cf8-86b3-039ca38b7cd5 req-cdfcc006-1e5f-4132-8594-cec48e093181 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049691 Aug 31 00:24:24.669999 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 365/725] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:24.855922 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-283d67bd-8459-4278-ad04-016139788bf1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "POST /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/action" status: 202 len: 0 microversion: 2.1 time: 0.613579 Aug 31 00:24:24.856827 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 361/726] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:24:24 2022] POST /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:24:24.890154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-6d39eec4-ea11-4584-a834-117ce1739b9c req-40ac6874-0540-4c65-b319-460e43f59f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcf0da7-a91d-495a-a34e-88095698fb1a", "tag": "fa6d8697-5c97-4a6e-a066-a4a09dee4e61"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:24.901031 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-6d39eec4-ea11-4584-a834-117ce1739b9c req-40ac6874-0540-4c65-b319-460e43f59f39 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:24.902134 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-6d39eec4-ea11-4584-a834-117ce1739b9c req-40ac6874-0540-4c65-b319-460e43f59f39 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:24.902880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-6d39eec4-ea11-4584-a834-117ce1739b9c req-40ac6874-0540-4c65-b319-460e43f59f39 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:24.914941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-6d39eec4-ea11-4584-a834-117ce1739b9c req-40ac6874-0540-4c65-b319-460e43f59f39 service nova] Creating event network-changed:fa6d8697-5c97-4a6e-a066-a4a09dee4e61 for instance 8dcf0da7-a91d-495a-a34e-88095698fb1a on hv-cinder-85220 Aug 31 00:24:24.921450 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-6d39eec4-ea11-4584-a834-117ce1739b9c req-40ac6874-0540-4c65-b319-460e43f59f39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035473 Aug 31 00:24:24.922937 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 366/727] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:26.096478 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c100cd5a-3660-4731-8b26-1f47133d5502 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'create', calling method: .version_select at 0x7fcd6bc545e0>, body: {"keypair": {"name": "tempest-keypair-925333364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9YvTXJUsDtiLIIEZgs5s9RTKgZzPAJ/eTOqKKzLFa2V+7UjDazMckzEfsgFb8Q5knx4wkUg2iIdDcjjTFxRtqg74mByS3cPNZYoGpP71/I1XdFu6QeIHClOzRiutc+Zg=="}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:26.112586 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-c100cd5a-3660-4731-8b26-1f47133d5502 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Getting quotas for project eed416bd0f5f4e2e8453db6ff35f6ac5. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:24:26.116840 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-c100cd5a-3660-4731-8b26-1f47133d5502 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Getting quotas for user a76438b57a2140cca853e0e71fb28f64 and project eed416bd0f5f4e2e8453db6ff35f6ac5. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:24:26.143796 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c100cd5a-3660-4731-8b26-1f47133d5502 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.054445 Aug 31 00:24:26.145077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 362/728] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 31 00:24:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 00:24:26.693224 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-290e3dc6-480c-4e49-91f0-5a4854c56960 req-2bf24292-9c05-4f94-b47d-6d05fa52b8bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f28e21f-660b-450f-9880-aa1b2b5a6e29", "tag": "49a7aa6e-4699-4230-9b6f-018c8e0162ed"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:26.711121 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-290e3dc6-480c-4e49-91f0-5a4854c56960 req-2bf24292-9c05-4f94-b47d-6d05fa52b8bc service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:26.711615 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-290e3dc6-480c-4e49-91f0-5a4854c56960 req-2bf24292-9c05-4f94-b47d-6d05fa52b8bc service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:26.712058 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-290e3dc6-480c-4e49-91f0-5a4854c56960 req-2bf24292-9c05-4f94-b47d-6d05fa52b8bc service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:26.726386 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-290e3dc6-480c-4e49-91f0-5a4854c56960 req-2bf24292-9c05-4f94-b47d-6d05fa52b8bc service nova] Creating event network-changed:49a7aa6e-4699-4230-9b6f-018c8e0162ed for instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 on hv-cinder-85220 Aug 31 00:24:26.730961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-290e3dc6-480c-4e49-91f0-5a4854c56960 req-2bf24292-9c05-4f94-b47d-6d05fa52b8bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041745 Aug 31 00:24:26.731883 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 367/729] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:27.045056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:27.045621 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:27.057712 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.058397 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.058843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.062368 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.063251 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.064342 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.071239 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-46019d14-bc4e-4b22-93d0-c598cfb16894 req-47e87c6a-7e12-4925-9fe6-c546aa3d7dea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcf0da7-a91d-495a-a34e-88095698fb1a", "tag": "fa6d8697-5c97-4a6e-a066-a4a09dee4e61"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:27.084434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-46019d14-bc4e-4b22-93d0-c598cfb16894 req-47e87c6a-7e12-4925-9fe6-c546aa3d7dea service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.122104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-46019d14-bc4e-4b22-93d0-c598cfb16894 req-47e87c6a-7e12-4925-9fe6-c546aa3d7dea service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.122871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-46019d14-bc4e-4b22-93d0-c598cfb16894 req-47e87c6a-7e12-4925-9fe6-c546aa3d7dea service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.153903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-46019d14-bc4e-4b22-93d0-c598cfb16894 req-47e87c6a-7e12-4925-9fe6-c546aa3d7dea service nova] Creating event network-changed:fa6d8697-5c97-4a6e-a066-a4a09dee4e61 for instance 8dcf0da7-a91d-495a-a34e-88095698fb1a on hv-cinder-85220 Aug 31 00:24:27.163740 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-46019d14-bc4e-4b22-93d0-c598cfb16894 req-47e87c6a-7e12-4925-9fe6-c546aa3d7dea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097630 Aug 31 00:24:27.165251 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 368/730] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:27.193132 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lazy-loading 'services' on Instance uuid 8dcf0da7-a91d-495a-a34e-88095698fb1a {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:27.285123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-11c7dbe9-6377-4492-b445-5d43040162c1 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments/6305d7dc-fcd2-4a82-98a6-dfac5a924cf2" status: 202 len: 0 microversion: 2.1 time: 0.244981 Aug 31 00:24:27.286923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 363/731] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:24:27 2022] DELETE /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments/6305d7dc-fcd2-4a82-98a6-dfac5a924cf2 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:24:27.298011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9ac0b9bd-1017-4ee7-99fc-f9e5a114e9f6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:27.301887 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9ac0b9bd-1017-4ee7-99fc-f9e5a114e9f6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:27.311442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ac0b9bd-1017-4ee7-99fc-f9e5a114e9f6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.312717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ac0b9bd-1017-4ee7-99fc-f9e5a114e9f6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.314067 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ac0b9bd-1017-4ee7-99fc-f9e5a114e9f6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.315680 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ac0b9bd-1017-4ee7-99fc-f9e5a114e9f6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:27.316421 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ac0b9bd-1017-4ee7-99fc-f9e5a114e9f6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:27.317175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9ac0b9bd-1017-4ee7-99fc-f9e5a114e9f6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:27.323005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:27.359359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9ac0b9bd-1017-4ee7-99fc-f9e5a114e9f6 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067595 Aug 31 00:24:27.360401 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 369/732] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:24:27 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:27.905929 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1098585386", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fde66121-8958-431f-b529-f1f260e01ad8"}], "security_groups": [{"name": "tempest-securitygroup--2136632459"}], "key_name": "tempest-keypair-925333364", "user_data": "}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:27.914965 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:28.015352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.network.neutron [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] validate_networks() for [('fde66121-8958-431f-b529-f1f260e01ad8', None, None, None, None, None)] {{(pid=132200) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:24:28.372099 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a7072aca-3087-4a76-9a76-6a40b9ab686c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:28.374451 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a7072aca-3087-4a76-9a76-6a40b9ab686c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:28.376930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:28.382628 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a7072aca-3087-4a76-9a76-6a40b9ab686c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.383109 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a7072aca-3087-4a76-9a76-6a40b9ab686c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.383548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a7072aca-3087-4a76-9a76-6a40b9ab686c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.384242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a7072aca-3087-4a76-9a76-6a40b9ab686c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.384696 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a7072aca-3087-4a76-9a76-6a40b9ab686c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.385123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a7072aca-3087-4a76-9a76-6a40b9ab686c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.419207 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a7072aca-3087-4a76-9a76-6a40b9ab686c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050762 Aug 31 00:24:28.419785 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 370/733] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:24:28 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:24:28.435014 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Flavor limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:24:28.435471 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Image limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:24:28.435929 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Flavor pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:24:28.436366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Image pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:24:28.436779 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:24:28.445479 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.446002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.446446 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.447171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:28.447629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:28.448053 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:28.465387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Getting quotas for project eed416bd0f5f4e2e8453db6ff35f6ac5. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:24:28.469419 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Getting quotas for user a76438b57a2140cca853e0e71fb28f64 and project eed416bd0f5f4e2e8453db6ff35f6ac5. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:24:28.481532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Going to run 1 instances... {{(pid=132200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:24:28.483948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:24:28.533064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bd2bc8ec-6d92-4fe4-905e-b0d3b176c133 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.631672 Aug 31 00:24:28.534579 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 364/734] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 31 00:24:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 00:24:28.546022 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-aefb8b94-d74c-4083-9fad-dd2b916e5984 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:28.546633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-aefb8b94-d74c-4083-9fad-dd2b916e5984 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:28.606398 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-aefb8b94-d74c-4083-9fad-dd2b916e5984 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:28.614186 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-aefb8b94-d74c-4083-9fad-dd2b916e5984 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:28.615697 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-aefb8b94-d74c-4083-9fad-dd2b916e5984 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:28.616796 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-aefb8b94-d74c-4083-9fad-dd2b916e5984 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1281 microversion: 2.20 time: 0.075045 Aug 31 00:24:28.617543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 371/735] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:28 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:29.432569 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-387bd430-f75b-4353-9032-a8ba7a932e51 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:29.434733 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-387bd430-f75b-4353-9032-a8ba7a932e51 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:29.441647 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387bd430-f75b-4353-9032-a8ba7a932e51 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.442203 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387bd430-f75b-4353-9032-a8ba7a932e51 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.442669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387bd430-f75b-4353-9032-a8ba7a932e51 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:29.444007 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387bd430-f75b-4353-9032-a8ba7a932e51 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.444478 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387bd430-f75b-4353-9032-a8ba7a932e51 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.444916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387bd430-f75b-4353-9032-a8ba7a932e51 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:29.473167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-387bd430-f75b-4353-9032-a8ba7a932e51 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Aug 31 00:24:29.473712 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 365/736] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:24:29 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:29.639489 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:29.640086 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:29.647350 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.647822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.648254 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:29.648919 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:29.649363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:29.649778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:29.709741 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:29.717610 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:29.719077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:29.720159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f38551fd-7ecb-445b-9fe8-a595887810fb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1285 microversion: 2.20 time: 0.084604 Aug 31 00:24:29.720713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 372/737] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:29 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:30.485422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-daea7890-a0c7-46de-b785-300072fcce42 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:30.497160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-daea7890-a0c7-46de-b785-300072fcce42 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:30.504257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-daea7890-a0c7-46de-b785-300072fcce42 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:30.504257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-daea7890-a0c7-46de-b785-300072fcce42 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:30.505025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-daea7890-a0c7-46de-b785-300072fcce42 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:30.505242 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-daea7890-a0c7-46de-b785-300072fcce42 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:30.505692 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-daea7890-a0c7-46de-b785-300072fcce42 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:30.506141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-daea7890-a0c7-46de-b785-300072fcce42 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:30.540540 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-daea7890-a0c7-46de-b785-300072fcce42 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059050 Aug 31 00:24:30.541439 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 366/738] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:24:30 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:24:30.742595 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:30.743210 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:30.749590 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:30.750199 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:30.750624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:30.751312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:30.751763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:30.752186 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:30.828054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:30.836880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:30.838336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:30.839470 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7dbb9f2d-4824-402e-997e-3328994a49f0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1277 microversion: 2.20 time: 0.101450 Aug 31 00:24:30.840053 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 373/739] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:30 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:31.552801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-602ba755-4121-4c6f-a1b9-b90cf70d164f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:31.562661 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-602ba755-4121-4c6f-a1b9-b90cf70d164f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:31.574060 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-602ba755-4121-4c6f-a1b9-b90cf70d164f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.574836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-602ba755-4121-4c6f-a1b9-b90cf70d164f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.575523 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-602ba755-4121-4c6f-a1b9-b90cf70d164f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.576513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-602ba755-4121-4c6f-a1b9-b90cf70d164f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.577321 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-602ba755-4121-4c6f-a1b9-b90cf70d164f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.578136 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-602ba755-4121-4c6f-a1b9-b90cf70d164f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.612679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-602ba755-4121-4c6f-a1b9-b90cf70d164f tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063964 Aug 31 00:24:31.618378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 367/740] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:24:31 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:24:31.624797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:31.625439 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:31.632194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.632681 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.633124 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.633910 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.634524 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.635343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.760982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] HTTP exception thrown: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a is not attached to volume 6305d7dc-fcd2-4a82-98a6-dfac5a924cf2 Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Request method failure captured: Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: DELETE /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments/6305d7dc-fcd2-4a82-98a6-dfac5a924cf2 HTTP/1.1 Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqk_shI4mNjPmaz5ZEDzoF59RaKtTDLZgwKMXJ943mhCXlO59lDLPkZXbYPmSzsZ377zEOInCead3ecQoue9obpAKCqPVdRvyRCxKYzIDZBATcbn3WcU-nBS4q_ean7YW7OEamC7AFBlL_O7x5kUS3DBkdA1X8XG0N23il8IwTgFU0s Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 96ac355089a14695a3e062290443283e Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-TestMinimumBasicScenario-1762387505 Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:24:31.763300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/96ac355089a14695a3e062290443283e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/96ac355089a14695a3e062290443283e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/96ac355089a14695a3e062290443283e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_96ac355089a14695a3e062290443283e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-TestMinimumBasicScenario-1762387505 Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 96ac355089a14695a3e062290443283e Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1762387505 Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-TestMinimumBasicScenario-1762387505-project Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: cdd2a01bf81d406e877a1c4ace635704 Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-TestMinimumBasicScenario-1762387505-project Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:24:31.764972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a is not attached to volume 6305d7dc-fcd2-4a82-98a6-dfac5a924cf2 Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'server_id': '8dcf0da7-a91d-495a-a34e-88095698fb1a', 'id': '6305d7dc-fcd2-4a82-98a6-dfac5a924cf2'} Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6305d7dc-fcd2-4a82-98a6-dfac5a924cf2. Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:24:31.765767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a is not attached to volume 6305d7dc-fcd2-4a82-98a6-dfac5a924cf2 Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a is not attached to volume 6305d7dc-fcd2-4a82-98a6-dfac5a924cf2 Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:31.767171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Returning 404 to user: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a is not attached to volume 6305d7dc-fcd2-4a82-98a6-dfac5a924cf2 {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:24:31.768275 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1e847d0e-ec59-47d3-8ef8-f082dc5a8b3c tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments/6305d7dc-fcd2-4a82-98a6-dfac5a924cf2" status: 404 len: 154 microversion: 2.1 time: 0.144833 Aug 31 00:24:31.768275 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 374/741] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:24:31 2022] DELETE /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a/os-volume_attachments/6305d7dc-fcd2-4a82-98a6-dfac5a924cf2 => generated 154 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:31.864594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:31.865223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:31.878625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.878625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.878625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.878625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:31.879013 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:31.879013 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:31.950120 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:31.958793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:31.960262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:31.961376 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a7b378cc-e1ba-4f65-b169-bb8c4791430d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1339 microversion: 2.20 time: 0.101128 Aug 31 00:24:31.962100 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 368/742] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:31 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:32.914768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:32.915310 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:32.922782 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.923260 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:32.923691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.924376 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.924820 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:32.925234 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:32.949568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:24:32.990039 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:32.991301 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:32.999088 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:32.999778 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.000379 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.001219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.002355 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.002967 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.032803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ca4e29fd-5487-437e-91d8-b5ea380abb39 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 204 len: 0 microversion: 2.1 time: 0.122202 Aug 31 00:24:33.034208 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 375/743] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:24:32 2022] DELETE /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:24:33.048593 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:33.049659 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:33.056462 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.057182 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.057617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.058548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.059004 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.059433 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.199618 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:33.201869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:33.209135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:33.210365 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bee15747-0c9a-4a98-a1d0-4a872cc071bd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1552 microversion: 2.1 time: 0.170242 Aug 31 00:24:33.210601 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:33.210942 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 376/744] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:33 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:33.218071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-01f66a59-311d-4cfc-a6f1-27ffac5600b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1407 microversion: 2.20 time: 0.226952 Aug 31 00:24:33.218071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 369/745] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:32 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:33.218248 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-db948beb-08a9-4d86-a5e2-8c355db0dcdd req-aa2c4fc0-3fe3-4189-a0a4-0a2d7c6b89cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd646c5-f435-4d57-acb3-1ceb01a56868", "tag": "3f18d97a-669b-4781-8b9e-7428a4c4fbda"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:33.225479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-db948beb-08a9-4d86-a5e2-8c355db0dcdd req-aa2c4fc0-3fe3-4189-a0a4-0a2d7c6b89cd service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:33.225976 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-db948beb-08a9-4d86-a5e2-8c355db0dcdd req-aa2c4fc0-3fe3-4189-a0a4-0a2d7c6b89cd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:33.226408 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-db948beb-08a9-4d86-a5e2-8c355db0dcdd req-aa2c4fc0-3fe3-4189-a0a4-0a2d7c6b89cd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:33.236882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-db948beb-08a9-4d86-a5e2-8c355db0dcdd req-aa2c4fc0-3fe3-4189-a0a4-0a2d7c6b89cd service nova] Creating event network-changed:3f18d97a-669b-4781-8b9e-7428a4c4fbda for instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 on hv-cinder-85220 Aug 31 00:24:33.241512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-db948beb-08a9-4d86-a5e2-8c355db0dcdd req-aa2c4fc0-3fe3-4189-a0a4-0a2d7c6b89cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029495 Aug 31 00:24:33.242118 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 377/746] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:34.231352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:34.231958 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:34.235401 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:34.236112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:34.238867 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.239918 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.240353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.241041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.241608 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.241940 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.242912 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.243458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.243895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.244584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:34.245045 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:34.245466 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:34.374788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:34.377277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:34.382412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-344ed687-45b2-4a68-9744-e4c2365a3aa3 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1552 microversion: 2.1 time: 0.155034 Aug 31 00:24:34.383015 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 370/747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:34 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:34.385686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:34.387360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:34.388698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-eb3c4659-d367-4f7f-981d-e30f5cf271ed tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1407 microversion: 2.20 time: 0.157995 Aug 31 00:24:34.389333 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 378/748] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:34 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:35.404464 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:35.405644 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:35.410381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:35.411030 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:35.412198 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:35.412683 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:35.413168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:35.413813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:35.414366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:35.414787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:35.417532 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:35.418069 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:35.418780 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:35.419481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:35.419933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:35.420356 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:35.638317 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:35.646369 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-018cf144-85af-46ae-98a9-ccc90a05712b tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1552 microversion: 2.1 time: 0.245774 Aug 31 00:24:35.646944 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 371/749] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:35 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1552 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:35.706556 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:35.715938 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:35.717385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:35.718532 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9092d4e2-fed7-45a6-92ff-b2488f6196cf tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1407 microversion: 2.20 time: 0.312033 Aug 31 00:24:35.719283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 379/750] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:35 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:36.218250 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-014c2f1f-64af-42e8-8d61-e80650471a7e req-c148df52-6ed5-4239-8770-cc936c12d2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcf0da7-a91d-495a-a34e-88095698fb1a", "name": "network-vif-deleted", "tag": "fa6d8697-5c97-4a6e-a066-a4a09dee4e61"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:36.230458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-014c2f1f-64af-42e8-8d61-e80650471a7e req-c148df52-6ed5-4239-8770-cc936c12d2bc service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.230929 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-014c2f1f-64af-42e8-8d61-e80650471a7e req-c148df52-6ed5-4239-8770-cc936c12d2bc service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.231353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-014c2f1f-64af-42e8-8d61-e80650471a7e req-c148df52-6ed5-4239-8770-cc936c12d2bc service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.244000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-014c2f1f-64af-42e8-8d61-e80650471a7e req-c148df52-6ed5-4239-8770-cc936c12d2bc service nova] Creating event network-vif-deleted:fa6d8697-5c97-4a6e-a066-a4a09dee4e61 for instance 8dcf0da7-a91d-495a-a34e-88095698fb1a on hv-cinder-85220 Aug 31 00:24:36.249278 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-014c2f1f-64af-42e8-8d61-e80650471a7e req-c148df52-6ed5-4239-8770-cc936c12d2bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Aug 31 00:24:36.250043 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 372/751] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:36.666941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:36.667552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:36.673958 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.674438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.674870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.675550 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.675995 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.676412 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.705589 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.706112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.706546 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.706986 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lazy-loading 'fault' on Instance uuid 8dcf0da7-a91d-495a-a34e-88095698fb1a {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:36.742096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:36.742884 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:36.748030 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:36.749575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.750087 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.750515 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.751200 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:36.751647 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:36.752064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:36.755614 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e42d6e0f-5c7d-4f4a-9933-02765e3a85bb tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1347 microversion: 2.1 time: 0.092667 Aug 31 00:24:36.756171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 380/752] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:36 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1347 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:36.881589 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:36.889994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:36.891502 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:36.892645 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-61502bb9-ced9-4fc6-9072-86ed16f3a6c1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1407 microversion: 2.20 time: 0.155372 Aug 31 00:24:36.893201 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 373/753] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:36 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:37.776295 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:37.777006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:37.783579 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:37.784062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:37.784500 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:37.785194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:37.785652 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:37.786681 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:37.816676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:37.817227 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:37.817665 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:37.818131 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lazy-loading 'fault' on Instance uuid 8dcf0da7-a91d-495a-a34e-88095698fb1a {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:37.857563 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd2a01bf81d406e877a1c4ace635704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac355089a14695a3e062290443283e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:37.865981 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-fa287e6e-7bb5-4bb5-bf44-8965780310cd tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 200 len: 1347 microversion: 2.1 time: 0.093538 Aug 31 00:24:37.866544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 381/754] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:37 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 1347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:37.917980 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:37.918923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:37.925360 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:37.925861 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:37.926378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:37.927650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:37.928101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:37.928559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:38.055000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:38.063141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:38.064609 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:38.066057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-01330281-c77a-4ef8-91d7-365778d5b3ef tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1407 microversion: 2.20 time: 0.151922 Aug 31 00:24:38.066610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 374/755] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:37 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:38.887388 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:38.889115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] [instance: 8dcf0da7-a91d-495a-a34e-88095698fb1a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:38.891485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:38.897929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:38.898631 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:38.899070 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:38.899775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:38.900231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:38.900659 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:38.915243 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] HTTP exception thrown: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a could not be found. Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Request method failure captured: Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a HTTP/1.1 Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqk_shI4mNjPmaz5ZEDzoF59RaKtTDLZgwKMXJ943mhCXlO59lDLPkZXbYPmSzsZ377zEOInCead3ecQoue9obpAKCqPVdRvyRCxKYzIDZBATcbn3WcU-nBS4q_ean7YW7OEamC7AFBlL_O7x5kUS3DBkdA1X8XG0N23il8IwTgFU0s Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 96ac355089a14695a3e062290443283e Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-TestMinimumBasicScenario-1762387505 Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:24:38.917548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/96ac355089a14695a3e062290443283e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/96ac355089a14695a3e062290443283e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/96ac355089a14695a3e062290443283e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_96ac355089a14695a3e062290443283e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-TestMinimumBasicScenario-1762387505 Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 96ac355089a14695a3e062290443283e Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1762387505 Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-TestMinimumBasicScenario-1762387505-project Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: cdd2a01bf81d406e877a1c4ace635704 Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-TestMinimumBasicScenario-1762387505-project Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a could not be found. Aug 31 00:24:38.919209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '8dcf0da7-a91d-495a-a34e-88095698fb1a'} Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a could not be found. Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:24:38.919983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a could not be found. Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a could not be found. Aug 31 00:24:38.921145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:24:38.922252 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Returning 404 to user: Instance 8dcf0da7-a91d-495a-a34e-88095698fb1a could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:24:38.922252 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-aefb6f9f-b0bd-41d4-8bfe-92505e3ecbe4 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a" status: 404 len: 111 microversion: 2.1 time: 0.036318 Aug 31 00:24:38.922252 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 382/756] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:38 2022] GET /compute/v2.1/servers/8dcf0da7-a91d-495a-a34e-88095698fb1a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:38.929048 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-52707481-fadf-472d-98f2-33c78c320d02 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] Calling method '.version_select at 0x7fcd6bbd2d30>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:38.939539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:38.940100 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=10 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:38.954497 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-52707481-fadf-472d-98f2-33c78c320d02 tempest-TestMinimumBasicScenario-1762387505 tempest-TestMinimumBasicScenario-1762387505-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-926676976" status: 202 len: 0 microversion: 2.1 time: 0.030243 Aug 31 00:24:38.958393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 375/757] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 31 00:24:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-926676976 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:24:39.088800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:39.089797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:39.096168 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:39.096719 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:39.097223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:39.098198 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:39.098769 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:39.099201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:39.231227 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:39.239958 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:39.241406 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:39.242544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2a063320-30c7-4f3f-bfb1-f4167d9662a3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1407 microversion: 2.20 time: 0.157977 Aug 31 00:24:39.243086 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 383/758] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:39 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:40.264595 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:40.265191 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:40.272245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:40.272720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:40.273148 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:40.273830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:40.274295 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:40.274714 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:40.496541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:40.504620 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:40.506092 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:40.507187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c9398c55-c80a-4c99-b2ed-7cd8ce4beef5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1407 microversion: 2.20 time: 0.246514 Aug 31 00:24:40.507970 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 376/759] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:40 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:41.088930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-26b7e322-3779-4be0-97dd-b8a0df407f81 req-13c86194-fa6d-4e4d-b501-f2ce2a57d914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd646c5-f435-4d57-acb3-1ceb01a56868", "name": "network-vif-plugged", "status": "completed", "tag": "3f18d97a-669b-4781-8b9e-7428a4c4fbda"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:41.098767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-26b7e322-3779-4be0-97dd-b8a0df407f81 req-13c86194-fa6d-4e4d-b501-f2ce2a57d914 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:41.099493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-26b7e322-3779-4be0-97dd-b8a0df407f81 req-13c86194-fa6d-4e4d-b501-f2ce2a57d914 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:41.100098 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-26b7e322-3779-4be0-97dd-b8a0df407f81 req-13c86194-fa6d-4e4d-b501-f2ce2a57d914 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:41.111574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-26b7e322-3779-4be0-97dd-b8a0df407f81 req-13c86194-fa6d-4e4d-b501-f2ce2a57d914 service nova] Creating event network-vif-plugged:3f18d97a-669b-4781-8b9e-7428a4c4fbda for instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 on hv-cinder-85220 Aug 31 00:24:41.117023 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-26b7e322-3779-4be0-97dd-b8a0df407f81 req-13c86194-fa6d-4e4d-b501-f2ce2a57d914 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107967 Aug 31 00:24:41.117617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 384/760] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:41.531892 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:41.532915 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:41.539959 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:41.540618 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:41.541357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:41.542728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:41.543562 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:41.544198 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:41.756338 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:41.770357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:41.771810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:41.772942 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7cd10767-fada-4115-bdfe-01e54fe1ebc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1407 microversion: 2.20 time: 0.246284 Aug 31 00:24:41.773504 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 377/761] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:41 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:42.805110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:42.805729 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:42.812466 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:42.812965 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:42.813404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:42.814162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:42.814617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:42.815042 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:43.031847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:43.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:43.042551 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:43.043985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6b5140c6-3215-4ea7-84c1-e36b9f3907ae tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1407 microversion: 2.20 time: 0.244255 Aug 31 00:24:43.044493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 385/762] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:42 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:24:44.067182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:44.067871 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:44.080702 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:44.081195 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:44.081512 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:44.082250 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:44.082750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:44.083176 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:44.228839 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:44.238110 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:44.239924 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:44.241171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-120f4c61-3a52-4a7c-8b80-cfae632d89ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1599 microversion: 2.20 time: 0.178168 Aug 31 00:24:44.241741 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 378/763] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:24:44 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:24:44.263162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a85859c9-c3f0-44a3-8548-a2957af24c76 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:44.263855 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a85859c9-c3f0-44a3-8548-a2957af24c76 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:44.270817 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a85859c9-c3f0-44a3-8548-a2957af24c76 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:44.271304 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a85859c9-c3f0-44a3-8548-a2957af24c76 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:44.271746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a85859c9-c3f0-44a3-8548-a2957af24c76 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:44.272467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a85859c9-c3f0-44a3-8548-a2957af24c76 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:44.273138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a85859c9-c3f0-44a3-8548-a2957af24c76 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:44.273574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a85859c9-c3f0-44a3-8548-a2957af24c76 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:44.294225 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:44.388822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a85859c9-c3f0-44a3-8548-a2957af24c76 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.129601 Aug 31 00:24:44.389420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 386/764] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 31 00:24:44 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:24:45.561036 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-50f6efd4-5b7c-49f2-82ff-59689b40ba79 req-d8374011-83d3-41a2-97bc-5e720f94d7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd646c5-f435-4d57-acb3-1ceb01a56868", "tag": "3f18d97a-669b-4781-8b9e-7428a4c4fbda"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:45.576590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-50f6efd4-5b7c-49f2-82ff-59689b40ba79 req-d8374011-83d3-41a2-97bc-5e720f94d7a7 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:45.578039 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-50f6efd4-5b7c-49f2-82ff-59689b40ba79 req-d8374011-83d3-41a2-97bc-5e720f94d7a7 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:45.578859 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-50f6efd4-5b7c-49f2-82ff-59689b40ba79 req-d8374011-83d3-41a2-97bc-5e720f94d7a7 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:45.597876 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-50f6efd4-5b7c-49f2-82ff-59689b40ba79 req-d8374011-83d3-41a2-97bc-5e720f94d7a7 service nova] Creating event network-changed:3f18d97a-669b-4781-8b9e-7428a4c4fbda for instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 on hv-cinder-85220 Aug 31 00:24:45.605982 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-50f6efd4-5b7c-49f2-82ff-59689b40ba79 req-d8374011-83d3-41a2-97bc-5e720f94d7a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276626 Aug 31 00:24:45.608260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 379/765] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:48.883924 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-746f9164-189d-4cde-9ec3-16711c887c67 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:48.886086 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-746f9164-189d-4cde-9ec3-16711c887c67 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:48.892013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-746f9164-189d-4cde-9ec3-16711c887c67 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:48.892497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-746f9164-189d-4cde-9ec3-16711c887c67 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:48.892933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-746f9164-189d-4cde-9ec3-16711c887c67 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:48.893623 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-746f9164-189d-4cde-9ec3-16711c887c67 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:48.894102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-746f9164-189d-4cde-9ec3-16711c887c67 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:48.894523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-746f9164-189d-4cde-9ec3-16711c887c67 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:48.924713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-746f9164-189d-4cde-9ec3-16711c887c67 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045394 Aug 31 00:24:48.925266 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 387/766] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:24:48 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:24:48.989170 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:48.989760 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:48.996251 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:48.996815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:48.997279 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:48.998016 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:48.998511 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:48.998940 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:49.023937 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:24:49.051144 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:49.108328 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6394321e-4069-4f2b-9d2d-00c9510144ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "DELETE /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 204 len: 0 microversion: 2.1 time: 0.124166 Aug 31 00:24:49.113111 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 380/767] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:24:48 2022] DELETE /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:24:49.118157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:49.118976 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:49.125257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:49.125742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:49.126447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:49.127225 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:49.127679 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:49.128102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:49.261524 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:49.269357 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b4452618-e919-49e1-b0ae-0a9bdf2a656c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1673 microversion: 2.1 time: 0.155353 Aug 31 00:24:49.270520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 388/768] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:49 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:50.291814 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:50.292684 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:50.299417 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:50.300019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:50.300681 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:50.301988 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:50.302560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:50.303085 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:50.436998 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:50.445739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-463ecf3b-6988-436e-908e-3c8c0cb569dc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1673 microversion: 2.1 time: 0.158114 Aug 31 00:24:50.446389 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 381/769] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:50 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:51.467363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:51.468575 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:51.475169 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:51.476001 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:51.476642 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:51.477352 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:51.478216 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:51.478795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:51.706643 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:51.722387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-24a9bdf9-c60e-47be-9c63-d482d9f3826b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1673 microversion: 2.1 time: 0.258725 Aug 31 00:24:51.724181 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 389/770] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:51 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:52.084521 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-57eed120-41d2-4bb2-82be-dcee88a98e2d req-c3b1e312-c18c-4298-bfe2-a0571eb1d3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd82cf1-9e95-469a-ae36-ffca42f83f3a", "name": "network-vif-deleted", "tag": "76733a2a-08f7-4f06-b114-63f2a8fc3f2a"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:52.133910 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-57eed120-41d2-4bb2-82be-dcee88a98e2d req-c3b1e312-c18c-4298-bfe2-a0571eb1d3ac service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.135280 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-57eed120-41d2-4bb2-82be-dcee88a98e2d req-c3b1e312-c18c-4298-bfe2-a0571eb1d3ac service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.135659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-57eed120-41d2-4bb2-82be-dcee88a98e2d req-c3b1e312-c18c-4298-bfe2-a0571eb1d3ac service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.160875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-57eed120-41d2-4bb2-82be-dcee88a98e2d req-c3b1e312-c18c-4298-bfe2-a0571eb1d3ac service nova] Creating event network-vif-deleted:76733a2a-08f7-4f06-b114-63f2a8fc3f2a for instance acd82cf1-9e95-469a-ae36-ffca42f83f3a on hv-cinder-85220 Aug 31 00:24:52.186052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-57eed120-41d2-4bb2-82be-dcee88a98e2d req-c3b1e312-c18c-4298-bfe2-a0571eb1d3ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105841 Aug 31 00:24:52.186661 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 382/771] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:52.748719 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:52.749391 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:52.756781 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.757641 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.758742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.759813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.760521 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.761173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.804613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:52.805192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:52.805707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:52.806769 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lazy-loading 'fault' on Instance uuid acd82cf1-9e95-469a-ae36-ffca42f83f3a {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:24:52.865471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:52.879323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-74e83508-0d1e-453e-8351-61bae246b26d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 200 len: 1327 microversion: 2.1 time: 0.134364 Aug 31 00:24:52.881134 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 390/772] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:52 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:53.903012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:53.903718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:53.910206 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:53.911010 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:53.911452 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:53.912204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:53.912601 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:53.913023 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:53.928676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] HTTP exception thrown: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Request method failure captured: Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a HTTP/1.1 Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj7xedGa9z-OTusjjyI_2eE_-0vOag6oMYMvJvodxgITzUDIJDaNXRm1TsLM2aHzzgGGm99gKbGX7sfNpM7a5jjdVKaO-zQh94BuWhQJXCBUhUr9T9aNvfOiC1ZVjp_-CfVi2b681nlB93UaLSs9pk8P331cNXQUBbeHQgM2EkrfEs Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:24:53.930372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 3f519b1d9a1149169b8142e738320a89 Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:24:53.931836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': 'acd82cf1-9e95-469a-ae36-ffca42f83f3a'} Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:24:53.936920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:24:53.939231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:24:53.942650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Returning 404 to user: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:24:53.942650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9691b522-f056-4f9e-a525-e98d57d64501 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 404 len: 111 microversion: 2.1 time: 0.033526 Aug 31 00:24:53.942650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 383/773] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:53 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:53.943088 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ea581ee2-b461-48e9-a254-14f10e7a0532 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '.version_select at 0x7fcd6bc08940>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:53.969221 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ea581ee2-b461-48e9-a254-14f10e7a0532 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-239562019" status: 202 len: 0 microversion: 2.1 time: 0.031677 Aug 31 00:24:53.972812 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 391/774] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 31 00:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-239562019 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:24:54.690888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5fd769ec-4341-49d5-879c-f27145d89b9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'create', calling method: .version_select at 0x7fcd6bbf0a60>, body: {"keypair": {"name": "tempest-keypair-1499228745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzp2X5aH7cDPwRuNB6CbYqFcMp3FFiif3u8MfqojO2qAi8Za/Z8VV/2JvrKwmn39EAHEXJBFsWHyO3ud8VH08xRG+n6C2MvJUrkQaMDPeHtVFbdp6kudH0mlWXhyV4INQ=="}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:54.709551 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-5fd769ec-4341-49d5-879c-f27145d89b9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Getting quotas for project 74bc2aed79de4b3d92d19ef9bf26cc51. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:24:54.713694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-5fd769ec-4341-49d5-879c-f27145d89b9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Getting quotas for user 3f519b1d9a1149169b8142e738320a89 and project 74bc2aed79de4b3d92d19ef9bf26cc51. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:24:54.739425 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5fd769ec-4341-49d5-879c-f27145d89b9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055755 Aug 31 00:24:54.740579 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 384/775] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:24:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:24:56.369170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-904930261", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f176d24e-2d9c-4a88-9bef-bf72b1c486af"}], "security_groups": [{"name": "tempest-securitygroup--1225667827"}], "key_name": "tempest-keypair-1499228745", "user_data": "}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:24:56.557222 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] validate_networks() for [('f176d24e-2d9c-4a88-9bef-bf72b1c486af', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:24:57.416451 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:24:57.417064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:24:57.417346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:24:57.418271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:24:57.418766 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:24:57.431188 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.431928 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.432561 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.433472 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:57.434126 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:57.434718 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:57.457663 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Getting quotas for project 74bc2aed79de4b3d92d19ef9bf26cc51. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:24:57.462785 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Getting quotas for user 3f519b1d9a1149169b8142e738320a89 and project 74bc2aed79de4b3d92d19ef9bf26cc51. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:24:57.476018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:24:57.479004 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:24:57.534688 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-40f1d2c4-4d54-477f-9ead-a23b372b6797 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.169719 Aug 31 00:24:57.537472 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 392/776] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:24:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:24:57.548484 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a7360ac4-8026-4883-b28d-0b134d83ae1b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:57.549733 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a7360ac4-8026-4883-b28d-0b134d83ae1b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:57.651894 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a7360ac4-8026-4883-b28d-0b134d83ae1b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:57.660266 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a7360ac4-8026-4883-b28d-0b134d83ae1b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1237 microversion: 2.1 time: 0.117070 Aug 31 00:24:57.663639 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 385/777] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:57 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:24:58.692666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:58.694698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:58.726400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:58.734244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:58.736501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:58.741546 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:58.742913 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:24:58.745515 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:24:58.747293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:24:58.947711 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:24:58.958721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b028d785-05b5-4cd3-a85d-3747ba011c9c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1289 microversion: 2.1 time: 0.276395 Aug 31 00:24:58.961963 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 393/778] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:58 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1289 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:24:59.992090 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:24:59.993287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:24:59.996908 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:00.003335 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:00.004737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:00.006250 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:00.007240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:00.009128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:00.009956 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:00.126105 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:00.142779 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-94374bab-fdf8-47eb-9359-a863b22f1d03 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1295 microversion: 2.1 time: 0.159818 Aug 31 00:25:00.146522 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 386/779] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:24:59 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1295 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:00.807303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-74a90ebd-e526-4ad4-a351-e24496e08ed9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Action: 'create', calling method: .version_select at 0x7fcd6bb52ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1059407937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVv8cneaGRGDAZYAjuRhO7OEcuyLk1EFOa+wfhk36NKV/75t4HNlPc7zNtEFcgd2DKPKRqqPQWQwgQvfAxWN1pV993KEc16MPYjTl5lFt+bO75XsllQAakgZPnwX0K5vA=="}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:00.826685 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-74a90ebd-e526-4ad4-a351-e24496e08ed9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Getting quotas for project bb6e5312ca7c4188b95dcab2a6edc7c6. Resources: {'key_pairs'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:00.832109 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-74a90ebd-e526-4ad4-a351-e24496e08ed9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Getting quotas for user 046c0674004e4747b4a365f26a5b8f5c and project bb6e5312ca7c4188b95dcab2a6edc7c6. Resources: {'key_pairs'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:00.856841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-74a90ebd-e526-4ad4-a351-e24496e08ed9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.307107 Aug 31 00:25:00.858192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 394/780] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:25:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:01.169033 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:01.169652 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:01.181360 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:01.181611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:01.182215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.187681 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:01.189983 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:01.190676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.420558 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:01.428839 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bad10f81-1e85-4129-80c6-39269f8dc64b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.265696 Aug 31 00:25:01.443406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 387/781] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:01 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:01.541899 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-e67efe0d-a25e-4575-bd82-30fe22dc644d req-c75c31e7-d937-4939-865b-d999f9f33863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a68b76-10b6-44b6-b459-9b5c469bb0b7", "tag": "e1fe3d3b-41e3-4469-99f8-484a2d4d0840"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:01.554532 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-e67efe0d-a25e-4575-bd82-30fe22dc644d req-c75c31e7-d937-4939-865b-d999f9f33863 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:01.555005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-e67efe0d-a25e-4575-bd82-30fe22dc644d req-c75c31e7-d937-4939-865b-d999f9f33863 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:01.555632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-e67efe0d-a25e-4575-bd82-30fe22dc644d req-c75c31e7-d937-4939-865b-d999f9f33863 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:01.566236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-e67efe0d-a25e-4575-bd82-30fe22dc644d req-c75c31e7-d937-4939-865b-d999f9f33863 service nova] Creating event network-changed:e1fe3d3b-41e3-4469-99f8-484a2d4d0840 for instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 on hv-cinder-85220 Aug 31 00:25:01.572614 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-e67efe0d-a25e-4575-bd82-30fe22dc644d req-c75c31e7-d937-4939-865b-d999f9f33863 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034272 Aug 31 00:25:01.573452 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 395/782] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:02.450792 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:02.451476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:02.459179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:02.460239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:02.461155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:02.462975 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:02.464215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:02.464791 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:02.625628 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:02.634766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9d2769a6-143c-4fcb-995f-dd4c018e9585 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.188152 Aug 31 00:25:02.648503 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 388/783] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:02 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:03.657103 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:03.657794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:03.664560 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:03.665040 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:03.665708 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:03.666589 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:03.667038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:03.667462 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:03.823660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:03.832071 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-41b6d7be-4cb6-4a07-ac91-2cd047dec1ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.179107 Aug 31 00:25:03.832634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 396/784] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:03 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:04.852533 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:04.853140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:04.859818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:04.860296 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:04.860736 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:04.861422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:04.862018 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:04.862450 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:04.997622 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:05.006266 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5ff741f7-4b35-46be-935c-dd8f3ae0ecb6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.157465 Aug 31 00:25:05.006838 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 389/785] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:04 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:05.842244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:05.843304 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:05.852604 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.853093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.853535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.854283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:05.854738 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:05.855162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:05.938798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lazy-loading 'services' on Instance uuid 6f28e21f-660b-450f-9880-aa1b2b5a6e29 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:06.030234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:06.030859 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:06.037737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:06.038267 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:06.038757 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:06.039730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:06.040462 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:06.041158 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:06.062569 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b992a5b2-7dda-46ab-a123-80ff39850580 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments/cdc8ae1a-8320-4962-8fa1-36205b830373" status: 202 len: 0 microversion: 2.1 time: 0.225981 Aug 31 00:25:06.063343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 397/786] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:25:05 2022] DELETE /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments/cdc8ae1a-8320-4962-8fa1-36205b830373 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:25:06.073503 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-804e9922-c2a0-4260-8ec8-4538f2530b49 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:06.075765 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-804e9922-c2a0-4260-8ec8-4538f2530b49 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:06.081882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-804e9922-c2a0-4260-8ec8-4538f2530b49 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:06.082386 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-804e9922-c2a0-4260-8ec8-4538f2530b49 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:06.082828 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-804e9922-c2a0-4260-8ec8-4538f2530b49 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:06.083524 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-804e9922-c2a0-4260-8ec8-4538f2530b49 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:06.083980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-804e9922-c2a0-4260-8ec8-4538f2530b49 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:06.084407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-804e9922-c2a0-4260-8ec8-4538f2530b49 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:06.117817 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-804e9922-c2a0-4260-8ec8-4538f2530b49 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048614 Aug 31 00:25:06.118636 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 398/787] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:25:06 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:06.200954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:06.209696 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3408ef74-1aeb-4c04-bc5f-68b78dcd59e6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.184829 Aug 31 00:25:06.210648 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 390/788] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:06 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:07.055725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-773ffb22-e3ff-4660-8662-67edf2ba260b req-dd8885b6-a26f-4bdc-9b16-1ccc7d563606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a68b76-10b6-44b6-b459-9b5c469bb0b7", "name": "network-vif-plugged", "status": "completed", "tag": "e1fe3d3b-41e3-4469-99f8-484a2d4d0840"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:07.068096 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-773ffb22-e3ff-4660-8662-67edf2ba260b req-dd8885b6-a26f-4bdc-9b16-1ccc7d563606 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.068578 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-773ffb22-e3ff-4660-8662-67edf2ba260b req-dd8885b6-a26f-4bdc-9b16-1ccc7d563606 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.069297 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-773ffb22-e3ff-4660-8662-67edf2ba260b req-dd8885b6-a26f-4bdc-9b16-1ccc7d563606 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.082325 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-773ffb22-e3ff-4660-8662-67edf2ba260b req-dd8885b6-a26f-4bdc-9b16-1ccc7d563606 service nova] Creating event network-vif-plugged:e1fe3d3b-41e3-4469-99f8-484a2d4d0840 for instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 on hv-cinder-85220 Aug 31 00:25:07.087453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-773ffb22-e3ff-4660-8662-67edf2ba260b req-dd8885b6-a26f-4bdc-9b16-1ccc7d563606 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040445 Aug 31 00:25:07.088048 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 399/789] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:25:07.130183 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8272acca-9d3d-4c4b-b4bd-2a9582ffff38 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:07.132331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8272acca-9d3d-4c4b-b4bd-2a9582ffff38 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:07.138758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8272acca-9d3d-4c4b-b4bd-2a9582ffff38 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.139258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8272acca-9d3d-4c4b-b4bd-2a9582ffff38 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.139682 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8272acca-9d3d-4c4b-b4bd-2a9582ffff38 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.140401 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8272acca-9d3d-4c4b-b4bd-2a9582ffff38 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.140854 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8272acca-9d3d-4c4b-b4bd-2a9582ffff38 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.141280 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8272acca-9d3d-4c4b-b4bd-2a9582ffff38 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.175886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8272acca-9d3d-4c4b-b4bd-2a9582ffff38 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049185 Aug 31 00:25:07.176785 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 391/790] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:25:07 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:07.231449 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:07.232144 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:07.239145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.239623 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.240126 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.240820 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:07.241275 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:07.241697 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:07.402802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:07.411076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-fff76bc5-6227-436c-9767-1eb23cac939e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.183737 Aug 31 00:25:07.412619 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 400/791] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:07 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:08.188863 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2f4b6809-d2c0-448e-9305-e165459c3cbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:08.190990 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2f4b6809-d2c0-448e-9305-e165459c3cbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:08.192881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=6 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:08.198770 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f4b6809-d2c0-448e-9305-e165459c3cbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.199253 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f4b6809-d2c0-448e-9305-e165459c3cbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.199691 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f4b6809-d2c0-448e-9305-e165459c3cbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.200380 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f4b6809-d2c0-448e-9305-e165459c3cbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.200832 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f4b6809-d2c0-448e-9305-e165459c3cbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.201258 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f4b6809-d2c0-448e-9305-e165459c3cbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.231424 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2f4b6809-d2c0-448e-9305-e165459c3cbf tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046602 Aug 31 00:25:08.232347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 392/792] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:25:08 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:25:08.309242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:08.309806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:08.311671 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:08.317356 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.317830 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.318283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.318997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.319443 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.319865 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.345266 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:25:08.432433 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-017f5101-7aed-4979-8d98-d0ab49f36f5a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 204 len: 0 microversion: 2.1 time: 0.126789 Aug 31 00:25:08.432732 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:08.433013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 401/793] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:25:08 2022] DELETE /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:25:08.433483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:08.439810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.440221 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.440659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.441347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.441454 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:08.441801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.442143 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:08.442294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.447985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.448465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.448899 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.449583 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:08.450062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:08.450482 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:08.577781 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:08.585497 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2f758708-6122-4c1a-94be-bb4642bda15e tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.156649 Aug 31 00:25:08.586103 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 393/794] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:08 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:08.587650 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:08.595579 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-238b43c2-0d26-4d06-b048-bb16a8659492 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1689 microversion: 2.1 time: 0.158409 Aug 31 00:25:08.596136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 402/795] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:08 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:09.607600 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:09.608214 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:09.615387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.615870 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.616311 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.617003 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.617458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.617919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.618122 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:09.618729 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:09.625095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.625572 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.626048 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.626771 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:09.627385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:09.627650 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:09.748524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:09.757168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bf1618d0-c15f-4998-9236-404d4048bebc tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.153142 Aug 31 00:25:09.758130 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 394/796] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:09 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:09.759532 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:09.767731 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d723a831-1937-4d28-a9ed-54167dd4e094 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1689 microversion: 2.1 time: 0.153367 Aug 31 00:25:09.768699 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 403/797] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:09 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:10.779738 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:10.780343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:10.786885 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.787365 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.787792 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.788349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:10.788767 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.788906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.789009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:10.789324 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.795653 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.796465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.796563 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.797238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:10.797691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:10.798145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:10.839259 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=10 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:10.919687 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:10.927394 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-90a2994a-825e-425f-9b04-b29702081593 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.151429 Aug 31 00:25:10.927973 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 395/798] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:10 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:10.934656 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:10.938271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:10.943806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-55f54038-1337-471e-9d62-89908c253128 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1689 microversion: 2.1 time: 0.159379 Aug 31 00:25:10.944387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 404/799] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:10 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:11.948499 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:11.949104 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:11.955652 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.956128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.956558 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:11.957237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.957682 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.958122 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:11.968246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:11.968905 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:11.976650 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.977081 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.977660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:11.978421 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:11.978878 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:11.979308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:12.103667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:12.111411 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-913e63de-7ccc-4120-8c7b-599f5c6dd021 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1363 microversion: 2.1 time: 0.166729 Aug 31 00:25:12.111984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 396/800] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:11 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:12.113244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:12.121282 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f7377cf7-b703-4ffe-ad5e-d425e9d137e3 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1689 microversion: 2.1 time: 0.158157 Aug 31 00:25:12.121833 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 405/801] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:11 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:13.133298 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:13.133838 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:13.140455 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.140935 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.141389 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.142102 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.142216 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:13.142626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.142816 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:13.142967 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.149714 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.150304 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.150746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.151442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.151903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.152332 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.295585 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:13.303848 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0684cf4e-3be2-4a44-ac78-3fa12d8a72d6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1549 microversion: 2.1 time: 0.174466 Aug 31 00:25:13.304463 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 397/802] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:13 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:13.304585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:13.312866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-33fae286-ce72-4b49-9b54-4a218888a2ac tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1689 microversion: 2.1 time: 0.174439 Aug 31 00:25:13.313427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 406/803] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:13 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:13.324470 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8335ec5e-a9a6-4a9b-b265-a8cf57cede28 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:13.324963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8335ec5e-a9a6-4a9b-b265-a8cf57cede28 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:13.330904 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8335ec5e-a9a6-4a9b-b265-a8cf57cede28 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.332005 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8335ec5e-a9a6-4a9b-b265-a8cf57cede28 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.332445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8335ec5e-a9a6-4a9b-b265-a8cf57cede28 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.333139 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8335ec5e-a9a6-4a9b-b265-a8cf57cede28 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:13.333592 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8335ec5e-a9a6-4a9b-b265-a8cf57cede28 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:13.334056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8335ec5e-a9a6-4a9b-b265-a8cf57cede28 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:13.411625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8335ec5e-a9a6-4a9b-b265-a8cf57cede28 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090966 Aug 31 00:25:13.412226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 398/804] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 31 00:25:13 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:14.342079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:14.342079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:14.342079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:14.342079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:14.342774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:14.342884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:14.343304 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:14.343730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:14.474117 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:14.484353 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cff7c328-a6f1-456c-a379-44fa5df34c15 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1689 microversion: 2.1 time: 0.154141 Aug 31 00:25:14.484942 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 407/805] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:14 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:15.080511 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-4f5d7a9e-7438-491a-8140-0cadc21edbf9 req-a9a28599-8274-4d0f-8e7e-6b8ac765c049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a68b76-10b6-44b6-b459-9b5c469bb0b7", "tag": "e1fe3d3b-41e3-4469-99f8-484a2d4d0840"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:15.092417 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-4f5d7a9e-7438-491a-8140-0cadc21edbf9 req-a9a28599-8274-4d0f-8e7e-6b8ac765c049 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.093232 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-4f5d7a9e-7438-491a-8140-0cadc21edbf9 req-a9a28599-8274-4d0f-8e7e-6b8ac765c049 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.093859 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-4f5d7a9e-7438-491a-8140-0cadc21edbf9 req-a9a28599-8274-4d0f-8e7e-6b8ac765c049 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.106535 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-4f5d7a9e-7438-491a-8140-0cadc21edbf9 req-a9a28599-8274-4d0f-8e7e-6b8ac765c049 service nova] Creating event network-changed:e1fe3d3b-41e3-4469-99f8-484a2d4d0840 for instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 on hv-cinder-85220 Aug 31 00:25:15.112588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-4f5d7a9e-7438-491a-8140-0cadc21edbf9 req-a9a28599-8274-4d0f-8e7e-6b8ac765c049 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036951 Aug 31 00:25:15.113741 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 399/806] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:15.505344 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:15.506039 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:15.521711 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.522503 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.523122 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.524041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.524662 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.525255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.568011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:15.568770 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:15.569387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:15.570078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lazy-loading 'fault' on Instance uuid 6f28e21f-660b-450f-9880-aa1b2b5a6e29 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:15.674093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:15.697160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ba98b050-02b8-4474-8b7b-765a6e01a90b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 200 len: 1336 microversion: 2.1 time: 0.196421 Aug 31 00:25:15.697830 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 408/807] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:15 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 1336 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:16.723326 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:16.724300 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6f28e21f-660b-450f-9880-aa1b2b5a6e29] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:16.730972 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.731455 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.731885 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.732577 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:16.733026 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:16.733445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:16.747634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] HTTP exception thrown: Instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 could not be found. Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Request method failure captured: Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 HTTP/1.1 Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj1A1kG2LdTorCDgkkVutZAVVGIaO4-7cOAUPDdewrt9JNvRFxPRTVO1_BKlI-5brYoD4Aac_PF8C4vrfca77Oa_HK8LAwmhL5pfRxTAmp-Z5nlkUqMCh13xrTQokK16igBIB5IBYPzSV0HilEnWbVpSU-HBpCeo0mcAS6-BzyFzOs Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:25:16.749320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: c924dfe7e9c941f9b7110c1a440633dc Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 could not be found. Aug 31 00:25:16.751056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '6f28e21f-660b-450f-9880-aa1b2b5a6e29'} Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 could not be found. Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:25:16.752024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 could not be found. Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 could not be found. Aug 31 00:25:16.754012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:16.755212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Returning 404 to user: Instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:25:16.755212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-dd933e21-bcb6-4c2a-8671-9dc7f8f77c12 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29" status: 404 len: 111 microversion: 2.1 time: 0.032890 Aug 31 00:25:16.755212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 400/808] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:16 2022] GET /compute/v2.1/servers/6f28e21f-660b-450f-9880-aa1b2b5a6e29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:25:16.759947 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-47e515cb-7e60-4af7-923c-6cd7365c019f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '.version_select at 0x7fcd6bb6f550>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:16.791913 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-47e515cb-7e60-4af7-923c-6cd7365c019f tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778436930" status: 202 len: 0 microversion: 2.1 time: 0.035683 Aug 31 00:25:16.792563 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 409/809] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 31 00:25:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778436930 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:25:17.130125 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-344709de-d8e8-4204-8249-0b46a2f427dc req-01c5e4b8-81a0-4d82-9560-45b7cc638407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f28e21f-660b-450f-9880-aa1b2b5a6e29", "name": "network-vif-deleted", "tag": "49a7aa6e-4699-4230-9b6f-018c8e0162ed"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:17.139379 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-344709de-d8e8-4204-8249-0b46a2f427dc req-01c5e4b8-81a0-4d82-9560-45b7cc638407 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:17.139854 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-344709de-d8e8-4204-8249-0b46a2f427dc req-01c5e4b8-81a0-4d82-9560-45b7cc638407 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:17.140284 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-344709de-d8e8-4204-8249-0b46a2f427dc req-01c5e4b8-81a0-4d82-9560-45b7cc638407 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:17.152107 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-344709de-d8e8-4204-8249-0b46a2f427dc req-01c5e4b8-81a0-4d82-9560-45b7cc638407 service nova] Creating event network-vif-deleted:49a7aa6e-4699-4230-9b6f-018c8e0162ed for instance 6f28e21f-660b-450f-9880-aa1b2b5a6e29 on hv-cinder-85220 Aug 31 00:25:17.156934 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-344709de-d8e8-4204-8249-0b46a2f427dc req-01c5e4b8-81a0-4d82-9560-45b7cc638407 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031143 Aug 31 00:25:17.157552 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 401/810] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:19.645469 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:19.646005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:19.651890 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.652372 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.652807 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.653495 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.653980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.654408 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.680079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:25:19.751901 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1ec7b17b-fe44-4d25-a70c-bce59a8adb56 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 204 len: 0 microversion: 2.1 time: 0.110220 Aug 31 00:25:19.752263 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 410/811] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:25:19 2022] DELETE /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:25:19.762094 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:19.762974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:19.769454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.770015 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.770462 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.771152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:19.771609 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:19.772035 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:19.776209 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:19.906513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:19.914747 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ac4d97f1-c4fd-4148-acbc-86258422ac11 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1508 microversion: 2.1 time: 0.157538 Aug 31 00:25:19.915309 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 402/812] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:19 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:20.688951 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-758107750", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1059407937", "security_groups": [{"name": "tempest-secgroup-smoke-1168371739"}], "networks": [{"uuid": "b034c80c-e41d-49d1-a8e9-38dd9aa8e346"}], "block_device_mapping_v2": [{"uuid": "c9577813-3e3a-42b9-ba99-9955f8fcd2a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:20.804410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] validate_networks() for [('b034c80c-e41d-49d1-a8e9-38dd9aa8e346', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:25:20.936558 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:20.937166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:20.944461 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:20.944944 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:20.945376 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:20.946123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:20.946793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:20.947220 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.075933 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:21.084260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a5d3d488-7663-4cca-8458-47cb2874f57a tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1508 microversion: 2.1 time: 0.151660 Aug 31 00:25:21.084920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 403/813] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:20 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:21.165518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:25:21.165970 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:25:21.166478 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:25:21.166890 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:25:21.167304 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:25:21.176824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.177308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.177743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.178501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.178961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.179424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.196814 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Getting quotas for project bb6e5312ca7c4188b95dcab2a6edc7c6. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:21.200800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Getting quotas for user 046c0674004e4747b4a365f26a5b8f5c and project bb6e5312ca7c4188b95dcab2a6edc7c6. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:21.257321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:25:21.259659 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c9577813-3e3a-42b9-ba99-9955f8fcd2a7',volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:25:21.387058 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5e6f390b-6d15-4cc9-84f6-1a2db4a9cdf9 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.702238 Aug 31 00:25:21.388318 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 411/814] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:25:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:25:21.399071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-61eea9f0-7ed5-402b-83e7-8c03412e62f7 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:21.399802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-61eea9f0-7ed5-402b-83e7-8c03412e62f7 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:21.459643 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-61eea9f0-7ed5-402b-83e7-8c03412e62f7 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:21.467724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-61eea9f0-7ed5-402b-83e7-8c03412e62f7 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1088 microversion: 2.1 time: 0.072610 Aug 31 00:25:21.468813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 404/815] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:21 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:21.867623 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-2da9b67e-d693-4236-a9ac-7ddd4faf2409 req-8f992dcd-349d-4197-a081-a1fd2a44bd82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0ed52f-01dd-4013-8576-086e53d0afc8", "name": "network-vif-deleted", "tag": "0858dfb7-8ad6-4e1f-807c-223b65e2a9b0"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:21.881608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-2da9b67e-d693-4236-a9ac-7ddd4faf2409 req-8f992dcd-349d-4197-a081-a1fd2a44bd82 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:21.882394 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-2da9b67e-d693-4236-a9ac-7ddd4faf2409 req-8f992dcd-349d-4197-a081-a1fd2a44bd82 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:21.883004 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-2da9b67e-d693-4236-a9ac-7ddd4faf2409 req-8f992dcd-349d-4197-a081-a1fd2a44bd82 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:21.897714 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-2da9b67e-d693-4236-a9ac-7ddd4faf2409 req-8f992dcd-349d-4197-a081-a1fd2a44bd82 service nova] Creating event network-vif-deleted:0858dfb7-8ad6-4e1f-807c-223b65e2a9b0 for instance 0a0ed52f-01dd-4013-8576-086e53d0afc8 on hv-cinder-85220 Aug 31 00:25:21.903415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-2da9b67e-d693-4236-a9ac-7ddd4faf2409 req-8f992dcd-349d-4197-a081-a1fd2a44bd82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104925 Aug 31 00:25:21.904421 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 412/816] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:22.104705 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:22.105385 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:22.113337 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.114115 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.114814 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.115693 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.116460 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.117073 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.164140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.164642 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.165187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.165566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lazy-loading 'fault' on Instance uuid 0a0ed52f-01dd-4013-8576-086e53d0afc8 {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:22.213517 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:22.222471 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a2843505-b862-4649-b0a0-6eb653bb5040 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 200 len: 1312 microversion: 2.1 time: 0.121819 Aug 31 00:25:22.234483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 405/817] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:22 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 1312 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:22.496877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:22.497593 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:22.503822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.504308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.504748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.505440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:22.505918 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:22.506349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:22.571189 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:22.578904 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-29c69085-fc7b-42af-b50d-7c56632d8a1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1186 microversion: 2.1 time: 0.086557 Aug 31 00:25:22.579472 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 413/818] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:22 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:23.243626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:23.244256 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 0a0ed52f-01dd-4013-8576-086e53d0afc8] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:23.251927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.252788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.253407 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.254155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.254849 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.255276 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.269977 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] HTTP exception thrown: Instance 0a0ed52f-01dd-4013-8576-086e53d0afc8 could not be found. Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Request method failure captured: Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 HTTP/1.1 Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj1A1kG2LdTorCDgkkVutZAVVGIaO4-7cOAUPDdewrt9JNvRFxPRTVO1_BKlI-5brYoD4Aac_PF8C4vrfca77Oa_HK8LAwmhL5pfRxTAmp-Z5nlkUqMCh13xrTQokK16igBIB5IBYPzSV0HilEnWbVpSU-HBpCeo0mcAS6-BzyFzOs Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:25:23.271634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: c924dfe7e9c941f9b7110c1a440633dc Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 0a0ed52f-01dd-4013-8576-086e53d0afc8 could not be found. Aug 31 00:25:23.273219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '0a0ed52f-01dd-4013-8576-086e53d0afc8'} Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0ed52f-01dd-4013-8576-086e53d0afc8 could not be found. Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:25:23.274240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0ed52f-01dd-4013-8576-086e53d0afc8 could not be found. Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0ed52f-01dd-4013-8576-086e53d0afc8 could not be found. Aug 31 00:25:23.275851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:23.277421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Returning 404 to user: Instance 0a0ed52f-01dd-4013-8576-086e53d0afc8 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:25:23.277421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1f5a7a4d-1ea6-4d25-9e95-11eedb3d15aa tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8" status: 404 len: 111 microversion: 2.1 time: 0.033672 Aug 31 00:25:23.277421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 406/819] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:23 2022] GET /compute/v2.1/servers/0a0ed52f-01dd-4013-8576-086e53d0afc8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:25:23.281816 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:23.282373 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:23.289260 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.289741 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.290228 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.291013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.291677 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.292271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.328346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:25:23.406295 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7a4c35f5-5a49-481d-bb5f-3da637bd1eca tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 204 len: 0 microversion: 2.1 time: 0.127919 Aug 31 00:25:23.410528 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 414/820] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:25:23 2022] DELETE /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:25:23.415703 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:23.416661 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:23.424972 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.425462 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.425938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.426640 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.427444 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.427876 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.563246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.571816 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2da19638-7130-4268-ba94-100f848e8632 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.160018 Aug 31 00:25:23.572380 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 407/821] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:23 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:23.601006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:23.601720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:23.607918 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.608501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.609035 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.609793 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:23.610383 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:23.610807 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:23.687948 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:23.695864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-af67857f-6391-442f-9b3a-598ea0a0c9ec tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1204 microversion: 2.1 time: 0.099567 Aug 31 00:25:23.696444 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 415/822] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:23 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:24.592101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:24.592709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:24.599735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.600230 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.600889 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.602019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.602787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.603462 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.716613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:24.717212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:24.724165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.724643 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.725075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.725753 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:24.726228 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:24.726646 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:24.733102 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:24.741025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6428d9d0-56a1-40da-aa34-4c2d06eb4c76 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.152780 Aug 31 00:25:24.741600 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 408/823] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:24 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:24.859087 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:24.867397 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1f7993f9-ef7e-403f-b3de-44b0cd8faf38 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1272 microversion: 2.1 time: 0.154692 Aug 31 00:25:24.867965 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 416/824] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:24 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:25.761673 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:25.762308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:25.769277 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.769755 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.770213 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.770896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.771344 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.771764 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.887723 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:25.888428 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:25.895206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.895694 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.896135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.896825 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:25.897274 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:25.897696 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:25.905663 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:25.913810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2f5a38de-fe1d-4c78-b589-fafdf4343c7e tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.155931 Aug 31 00:25:25.914408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 409/825] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:25 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:26.026085 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:26.034211 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8cbf4100-0201-44c8-a24a-3bbeef27a06a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1272 microversion: 2.1 time: 0.149853 Aug 31 00:25:26.034773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 417/826] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:25 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:26.719461 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-97e2bd27-5721-40fe-80b1-0af4c5ad0116 req-3522a3f5-5492-4030-a7b0-2d9ce8859f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6598868f-94b6-4429-90ba-8ccf12c92c6c", "tag": "f6ac30ae-f9d0-46c7-b217-0d25aa55a23b"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:26.730457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-97e2bd27-5721-40fe-80b1-0af4c5ad0116 req-3522a3f5-5492-4030-a7b0-2d9ce8859f14 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.730927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-97e2bd27-5721-40fe-80b1-0af4c5ad0116 req-3522a3f5-5492-4030-a7b0-2d9ce8859f14 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.731347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-97e2bd27-5721-40fe-80b1-0af4c5ad0116 req-3522a3f5-5492-4030-a7b0-2d9ce8859f14 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.743260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-97e2bd27-5721-40fe-80b1-0af4c5ad0116 req-3522a3f5-5492-4030-a7b0-2d9ce8859f14 service nova] Creating event network-changed:f6ac30ae-f9d0-46c7-b217-0d25aa55a23b for instance 6598868f-94b6-4429-90ba-8ccf12c92c6c on hv-cinder-85220 Aug 31 00:25:26.748111 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-97e2bd27-5721-40fe-80b1-0af4c5ad0116 req-3522a3f5-5492-4030-a7b0-2d9ce8859f14 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032448 Aug 31 00:25:26.748700 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 410/827] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:25:26.935793 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:26.937131 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:26.944312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.944797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.945428 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:26.946345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:26.947021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:26.947462 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.061800 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:27.063686 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:27.070140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:27.070726 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:27.071227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.072247 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:27.073020 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:27.073678 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.165000 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:27.174164 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0745f7d3-d249-4170-8988-6d02cc084d02 tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1522 microversion: 2.1 time: 0.242237 Aug 31 00:25:27.174738 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 418/828] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:26 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:27.286967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-9ad740c5-eedb-4ba4-802d-51b36ff5353b req-aa16599d-5def-4da1-8e1c-ecb91110f003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b85b900-da07-4c75-b7f3-4d0681c11d3a", "name": "network-vif-deleted", "tag": "91d0ea44-40c9-4a3e-b2ec-4b47827fa644"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:27.294037 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:27.298644 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-9ad740c5-eedb-4ba4-802d-51b36ff5353b req-aa16599d-5def-4da1-8e1c-ecb91110f003 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:27.299163 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-9ad740c5-eedb-4ba4-802d-51b36ff5353b req-aa16599d-5def-4da1-8e1c-ecb91110f003 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:27.299622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-9ad740c5-eedb-4ba4-802d-51b36ff5353b req-aa16599d-5def-4da1-8e1c-ecb91110f003 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:27.303431 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:27.311806 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-91999b24-e23c-40e3-a243-cd238df61c57 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.260103 Aug 31 00:25:27.312679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 411/829] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:27 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:27.327692 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-9ad740c5-eedb-4ba4-802d-51b36ff5353b req-aa16599d-5def-4da1-8e1c-ecb91110f003 service nova] Creating event network-vif-deleted:91d0ea44-40c9-4a3e-b2ec-4b47827fa644 for instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a on hv-cinder-85220 Aug 31 00:25:27.332876 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-9ad740c5-eedb-4ba4-802d-51b36ff5353b req-aa16599d-5def-4da1-8e1c-ecb91110f003 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050497 Aug 31 00:25:27.333485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 419/830] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:28.196358 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:28.196974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:28.203441 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.203928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.204367 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.205059 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.205513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.205969 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.238187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.238662 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.239091 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.239530 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lazy-loading 'fault' on Instance uuid 6b85b900-da07-4c75-b7f3-4d0681c11d3a {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:28.280075 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c924dfe7e9c941f9b7110c1a440633dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0043c999ad9d451ab45c19cbea1765ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:28.287629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d18ff844-b778-465f-951e-e6bc26e1846b tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 200 len: 1311 microversion: 2.1 time: 0.095284 Aug 31 00:25:28.288196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 412/831] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:28 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:28.339722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:28.340344 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:28.346617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.347094 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.347533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.348209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:28.348654 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:28.349070 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:28.541531 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:28.545682 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:28.553768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b774f86b-caf7-4597-a5cb-630f069760b6 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.219777 Aug 31 00:25:28.555063 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 420/832] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:28 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:29.308614 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:29.309223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] [instance: 6b85b900-da07-4c75-b7f3-4d0681c11d3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:29.316447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.316928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.317364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:29.318075 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.318530 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.318960 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:29.332185 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] HTTP exception thrown: Instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a could not be found. Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Request method failure captured: Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a HTTP/1.1 Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj1A1kG2LdTorCDgkkVutZAVVGIaO4-7cOAUPDdewrt9JNvRFxPRTVO1_BKlI-5brYoD4Aac_PF8C4vrfca77Oa_HK8LAwmhL5pfRxTAmp-Z5nlkUqMCh13xrTQokK16igBIB5IBYPzSV0HilEnWbVpSU-HBpCeo0mcAS6-BzyFzOs Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:25:29.333877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0043c999ad9d451ab45c19cbea1765ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 0043c999ad9d451ab45c19cbea1765ea Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-795497443 Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: c924dfe7e9c941f9b7110c1a440633dc Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-795497443-project Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a could not be found. Aug 31 00:25:29.335538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '6b85b900-da07-4c75-b7f3-4d0681c11d3a'} Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a could not be found. Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:25:29.336434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a could not be found. Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a could not be found. Aug 31 00:25:29.337949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:25:29.339318 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] Returning 404 to user: Instance 6b85b900-da07-4c75-b7f3-4d0681c11d3a could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:25:29.339318 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c845d7d0-580c-4613-9b12-194d601e9fec tempest-ServerRescueNegativeTestJSON-795497443 tempest-ServerRescueNegativeTestJSON-795497443-project] 10.222.0.49 "GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a" status: 404 len: 111 microversion: 2.1 time: 0.030573 Aug 31 00:25:29.339318 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 413/833] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:29 2022] GET /compute/v2.1/servers/6b85b900-da07-4c75-b7f3-4d0681c11d3a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:25:29.575919 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:29.576576 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:29.584993 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.585477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.585945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:29.586660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:29.587125 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:29.587554 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:29.718560 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:29.726851 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-df83cfd4-f55d-4bc7-9639-84e32704e0a4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.155511 Aug 31 00:25:29.727427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 421/834] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:29 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:30.368316 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-578172cc-62f9-4a12-9b81-ba78b1f90121 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:30.368852 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-578172cc-62f9-4a12-9b81-ba78b1f90121 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:30.371468 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=62 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:30.376738 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-578172cc-62f9-4a12-9b81-ba78b1f90121 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:30.377779 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-578172cc-62f9-4a12-9b81-ba78b1f90121 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:30.378289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-578172cc-62f9-4a12-9b81-ba78b1f90121 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:30.379019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-578172cc-62f9-4a12-9b81-ba78b1f90121 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:30.379493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-578172cc-62f9-4a12-9b81-ba78b1f90121 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:30.379953 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-578172cc-62f9-4a12-9b81-ba78b1f90121 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:30.404804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-578172cc-62f9-4a12-9b81-ba78b1f90121 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/ips" status: 200 len: 152 microversion: 2.20 time: 0.040789 Aug 31 00:25:30.405396 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 414/835] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 31 00:25:30 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:25:30.747415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:30.748093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:30.754954 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:30.755428 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:30.755864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:30.756565 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:30.757021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:30.757453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:30.900412 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:30.908966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b9180ebc-c083-4f84-99e3-d32d732b1e3b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.164998 Aug 31 00:25:30.909548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 422/836] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:30 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:31.930113 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:31.930825 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:31.933272 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:31.939943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.940440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.940873 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:31.941772 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:31.942309 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:31.942911 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.135196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:32.145616 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8168cc25-3eb0-4451-b747-e5340b692bc8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.219461 Aug 31 00:25:32.146367 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 415/837] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:31 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:32.818284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:32.818900 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:32.820825 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:32.821578 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=6 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:32.827885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.828362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.828793 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.829483 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:32.829955 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:32.830919 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:32.854345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lazy-loading 'flavor' on Instance uuid 3fd646c5-f435-4d57-acb3-1ceb01a56868 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:33.046154 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-45c8cc6e-2174-445f-8a0d-211510caa6b5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/action" status: 202 len: 0 microversion: 2.20 time: 0.232243 Aug 31 00:25:33.046928 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 423/838] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 31 00:25:32 2022] POST /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:25:33.055116 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:33.055764 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:33.062330 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.062815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.063248 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.063945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.064446 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.064872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.170173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:33.171015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:33.177571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.178117 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.178734 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.179883 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:33.180525 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:33.181130 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:33.201641 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.214985 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.217197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.218411 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a774bc8c-bab5-4eff-a34f-61dedc415bc2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.167284 Aug 31 00:25:33.219010 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 416/839] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:33 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:33.332725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:33.341195 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-f4005389-3824-468a-9eff-e0952cdf83d0 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.176690 Aug 31 00:25:33.341949 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 424/840] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:33 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:34.242970 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:34.243633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:34.250576 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.251066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.251502 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.252202 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.252654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.253081 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.363188 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:34.363741 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:34.370710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.371275 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.371775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.372539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:34.373054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:34.373541 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:34.439045 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:34.448559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:34.450310 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:34.451830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3e980df9-dd61-4494-b86b-1635ddf97d01 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.213018 Aug 31 00:25:34.452644 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 417/841] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:34 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:34.522837 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:34.530832 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b5ba77bd-a32d-4e53-b81b-f5080184d86e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.172767 Aug 31 00:25:34.531525 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 425/842] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:34 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:35.482353 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:35.483489 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:35.491525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:35.492053 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:35.492510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.493481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:35.494000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:35.494482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.553147 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:35.553785 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:35.560601 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:35.561097 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:35.561541 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.562321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:35.562781 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:35.563212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:35.705204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.713624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7bcd8003-342c-4970-9b49-b5e1a5ce6330 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.165203 Aug 31 00:25:35.714264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 426/843] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:35 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:35.952989 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.963754 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.966332 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:35.967932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8cb93d92-d0b0-4e1b-956d-d8a0a526fed2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.491876 Aug 31 00:25:35.968835 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 418/844] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:35 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:36.736903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:36.738291 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:36.744991 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.745719 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.746345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.747059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.747522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.747953 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:36.957368 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:36.966017 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9b571b59-7138-4723-bb08-4b93334d079a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.233752 Aug 31 00:25:36.978043 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 427/845] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:36 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:36.991271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:36.991943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:36.998720 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:36.999207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:36.999639 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.000636 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.001149 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.001598 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.146694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.161551 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.163372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:37.164561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-72eb4b09-c4db-4b1e-9452-981b61b3b23e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.177580 Aug 31 00:25:37.172397 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 419/846] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:36 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:37.448643 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-f8a3f56e-6ede-4621-94fa-ae1d8424098f req-12d0faa5-4658-4601-9610-4d0194c75d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6598868f-94b6-4429-90ba-8ccf12c92c6c", "name": "network-vif-plugged", "status": "completed", "tag": "f6ac30ae-f9d0-46c7-b217-0d25aa55a23b"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:37.464197 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-f8a3f56e-6ede-4621-94fa-ae1d8424098f req-12d0faa5-4658-4601-9610-4d0194c75d92 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.465139 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-f8a3f56e-6ede-4621-94fa-ae1d8424098f req-12d0faa5-4658-4601-9610-4d0194c75d92 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.465813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-f8a3f56e-6ede-4621-94fa-ae1d8424098f req-12d0faa5-4658-4601-9610-4d0194c75d92 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.487739 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-f8a3f56e-6ede-4621-94fa-ae1d8424098f req-12d0faa5-4658-4601-9610-4d0194c75d92 service nova] Creating event network-vif-plugged:f6ac30ae-f9d0-46c7-b217-0d25aa55a23b for instance 6598868f-94b6-4429-90ba-8ccf12c92c6c on hv-cinder-85220 Aug 31 00:25:37.496091 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-f8a3f56e-6ede-4621-94fa-ae1d8424098f req-12d0faa5-4658-4601-9610-4d0194c75d92 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050967 Aug 31 00:25:37.496896 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 428/847] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:37.988260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:37.989320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:37.996963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.997619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.997915 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:37.998939 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:37.999557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:37.999997 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.195509 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:38.196580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:38.210925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.211430 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.211874 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.212590 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:38.217328 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:38.223163 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:38.226329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.243686 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d122baf5-bad0-4fdb-84e2-942d9ce0479a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.259703 Aug 31 00:25:38.244392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 420/848] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:37 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:38.455074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.473031 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.476206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:38.477432 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e63d5f6e-4220-4c11-81b6-7816e7a4921d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.286262 Aug 31 00:25:38.478025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 429/849] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:38 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:38.714255 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-eeb4d037-3687-4a91-ae63-a94d06193502 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: .version_select at 0x7fcd7363dee0>, body: {"keypair": {"name": "tempest-keypair-925210269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaRv/Gr+kpVcuWuNkuPB3cmr3bp3ENzHUpTP0GFBo6z67ol0LKUpMUBunIrQQu4KrkS56cKUinPF1iskZX25MEFko3wkkkxmoiSQsht2PjgjdRU7sV0U8+Uf20UmmeWtA=="}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:38.730215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-eeb4d037-3687-4a91-ae63-a94d06193502 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:38.734107 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-eeb4d037-3687-4a91-ae63-a94d06193502 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for user 988168279e8e495a985e209a35764f2b and project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:38.757074 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-eeb4d037-3687-4a91-ae63-a94d06193502 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182934 Aug 31 00:25:38.757682 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 421/850] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:25:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:39.266157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:39.267608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:39.274859 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.275341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.276029 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.277079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.277544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.277990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.429736 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:39.440742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-96d4927f-081d-49dc-9a0f-2a3199e65a73 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1260 microversion: 2.1 time: 0.178489 Aug 31 00:25:39.442238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 430/851] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:39 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:39.505432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:39.506261 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:39.513733 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.514979 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.514979 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.515495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:39.515945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:39.516512 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:39.532152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:39.728980 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:39.743026 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:39.752460 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:39.754312 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-38354a33-77b5-45e9-be61-c0d3cc809fb5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.255074 Aug 31 00:25:39.755673 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 422/852] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:39 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:40.170216 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1907758819", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c68b95b5-2004-4926-97ca-43c398029473"}], "security_groups": [{"name": "tempest-securitygroup--1242094687"}], "key_name": "tempest-keypair-925210269", "user_data": "}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:40.277323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] validate_networks() for [('c68b95b5-2004-4926-97ca-43c398029473', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:25:40.460721 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:40.461428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:40.467788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.468340 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.468845 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.469604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.470202 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.470694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.614865 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.622990 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ab156c0a-7f9c-4be7-ba03-a763517f8f29 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1444 microversion: 2.1 time: 0.166207 Aug 31 00:25:40.623559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 423/853] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:40 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:40.643614 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:40.644229 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:40.650332 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.650815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.651250 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.651938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.652385 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.652807 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.689531 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:25:40.689997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:25:40.690684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:25:40.691267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:25:40.691858 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:25:40.700990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.701472 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.702172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.703072 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.703749 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.704377 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.723447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:40.727873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for user 988168279e8e495a985e209a35764f2b and project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:40.740680 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:25:40.743497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:25:40.796166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cd201303-c513-4976-a904-38ba09cea866 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.630869 Aug 31 00:25:40.797153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 431/854] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:25:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:25:40.807020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:40.807841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:40.813651 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.822169 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-da006d88-0e8a-4ab4-9fff-1464b1143660 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1444 microversion: 2.1 time: 0.183378 Aug 31 00:25:40.823349 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 424/855] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:40 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1444 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:40.828102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.828247 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-833a50ad-f63c-449b-9d03-2c16a0450534 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:40.828817 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.829278 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-833a50ad-f63c-449b-9d03-2c16a0450534 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:40.829413 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.830287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:40.830906 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:40.831669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:40.932458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-833a50ad-f63c-449b-9d03-2c16a0450534 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:40.942234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-833a50ad-f63c-449b-9d03-2c16a0450534 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1241 microversion: 2.1 time: 0.116731 Aug 31 00:25:40.942811 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 425/856] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:40 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:40.998714 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.012612 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.014125 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:41.016015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9978c874-773c-4e71-afc5-f7259e31f94f tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.213135 Aug 31 00:25:41.017036 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 432/857] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:40 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:41.963072 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:41.964282 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:41.971968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:41.972664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:41.973286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:41.974000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:41.974448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:41.974887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:42.039496 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:42.040890 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:42.048014 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:42.049025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:42.049462 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:42.050410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:42.050875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:42.051435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:42.061005 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:42.070676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-59380d0a-62c6-4ff9-b102-83e46c7efe4a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1293 microversion: 2.1 time: 0.110958 Aug 31 00:25:42.075818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 426/858] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:41 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:42.211455 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:42.220896 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:42.224567 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:42.226057 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b876bc24-34f3-4d4d-8905-a76c911a3788 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.191083 Aug 31 00:25:42.226776 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 433/859] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:42 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:42.945285 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-be6e699c-d5a8-460d-8b1c-23b85222b0ff req-bb4e27d5-4330-43dd-b4a5-6d0bd24aedd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6598868f-94b6-4429-90ba-8ccf12c92c6c", "tag": "f6ac30ae-f9d0-46c7-b217-0d25aa55a23b"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:42.958604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-be6e699c-d5a8-460d-8b1c-23b85222b0ff req-bb4e27d5-4330-43dd-b4a5-6d0bd24aedd6 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:42.959018 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-be6e699c-d5a8-460d-8b1c-23b85222b0ff req-bb4e27d5-4330-43dd-b4a5-6d0bd24aedd6 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:42.960683 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-be6e699c-d5a8-460d-8b1c-23b85222b0ff req-bb4e27d5-4330-43dd-b4a5-6d0bd24aedd6 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:42.974465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-be6e699c-d5a8-460d-8b1c-23b85222b0ff req-bb4e27d5-4330-43dd-b4a5-6d0bd24aedd6 service nova] Creating event network-changed:f6ac30ae-f9d0-46c7-b217-0d25aa55a23b for instance 6598868f-94b6-4429-90ba-8ccf12c92c6c on hv-cinder-85220 Aug 31 00:25:42.982141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-be6e699c-d5a8-460d-8b1c-23b85222b0ff req-bb4e27d5-4330-43dd-b4a5-6d0bd24aedd6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039975 Aug 31 00:25:42.986628 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 427/860] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:43.098464 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:43.099738 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:43.107005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.107832 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.108519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.109456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.110152 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.110858 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.257394 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:43.259742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:43.273718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.274542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.276099 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.277082 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:43.277758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:43.278545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:43.442594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.453486 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ba86fc9c-d664-4eb1-aafa-7ba2d0934d14 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1367 microversion: 2.1 time: 0.360766 Aug 31 00:25:43.459268 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 434/861] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:43 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:43.760327 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.772201 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.773876 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:43.775488 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-07ebdb4c-d0b9-488b-b1bc-abb9af13bce4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.526622 Aug 31 00:25:43.776396 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 428/862] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:43 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:44.012102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-e07b0c29-df09-42dd-a068-5764064f8d2c req-5a1f8ebd-d557-4610-8728-5c8c70aeba93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf2e097-da9b-4e83-a63c-bbd6fa880158", "tag": "6d187a0d-3cb9-4e2e-8bff-83480e41ed84"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:44.024192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-e07b0c29-df09-42dd-a068-5764064f8d2c req-5a1f8ebd-d557-4610-8728-5c8c70aeba93 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.024781 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-e07b0c29-df09-42dd-a068-5764064f8d2c req-5a1f8ebd-d557-4610-8728-5c8c70aeba93 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.026054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-e07b0c29-df09-42dd-a068-5764064f8d2c req-5a1f8ebd-d557-4610-8728-5c8c70aeba93 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.038730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-e07b0c29-df09-42dd-a068-5764064f8d2c req-5a1f8ebd-d557-4610-8728-5c8c70aeba93 service nova] Creating event network-changed:6d187a0d-3cb9-4e2e-8bff-83480e41ed84 for instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 on hv-cinder-85220 Aug 31 00:25:44.044665 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-e07b0c29-df09-42dd-a068-5764064f8d2c req-5a1f8ebd-d557-4610-8728-5c8c70aeba93 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036131 Aug 31 00:25:44.045513 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 435/863] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:44.479481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:44.480090 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:44.487739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.488223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.488654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.489395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.489861 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.490298 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.622740 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:44.630544 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d42f16a0-cba1-40b3-8c21-54f7c99db782 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1367 microversion: 2.1 time: 0.154967 Aug 31 00:25:44.631110 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 429/864] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:44 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:44.802429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:44.803298 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:44.810072 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.810564 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.811005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.811697 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:44.812153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:44.812646 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:44.952442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:44.960690 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:44.962262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:44.963459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3bf95a66-6737-4531-bb18-cf9f977a5771 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.166003 Aug 31 00:25:44.964016 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 436/865] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:44 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:45.651282 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:45.651925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:45.657984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.658467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.658902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.659590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.660040 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.660466 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.787153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:45.794963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-906aa66f-22a1-4d89-b0b1-ac7eafcbb363 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1367 microversion: 2.1 time: 0.147766 Aug 31 00:25:45.795518 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 430/866] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:45 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:45.986469 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:45.987078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:45.993639 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.994228 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.994671 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:45.995356 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:45.995837 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:45.996262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.014876 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:46.125210 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.133787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.135246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.136400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6a792be1-a64a-4778-8a75-7a1325797d7b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.154096 Aug 31 00:25:46.136949 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 437/867] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:45 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:46.815873 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:46.816453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:46.822830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.823306 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.823738 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.824421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.824877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.825330 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.851036 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:46.851576 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:46.858841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.859337 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.859778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.860520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.860986 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.861473 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.887704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:25:46.958240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:46.964210 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-90982425-2a9f-40e9-b6f3-05c0cc5616cd tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "DELETE /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 204 len: 0 microversion: 2.1 time: 0.116956 Aug 31 00:25:46.965003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 438/868] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:25:46 2022] DELETE /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:25:46.968308 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-49f1ce5d-69ba-4e68-afb6-06b89cab46ae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1367 microversion: 2.1 time: 0.156507 Aug 31 00:25:46.968881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 431/869] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:46 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:46.974015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:46.974720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:46.981008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.981543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.982014 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:46.982762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:46.983160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:46.983580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.113987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.121834 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e2fb95b7-ce1f-46a1-9cb3-d524857d3c0e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1575 microversion: 2.1 time: 0.152596 Aug 31 00:25:47.122498 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 439/870] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:46 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:47.160055 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:47.160657 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:47.166547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.167273 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.167706 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.168385 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.168834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.169279 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.300069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.308376 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.309797 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:47.311177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-10df7ef1-6dcf-44ab-8c4c-0ff1f453ff87 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.155595 Aug 31 00:25:47.318327 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 432/871] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:47 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:47.991055 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:47.991585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:47.997516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.998046 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:47.998480 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:47.999161 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:47.999610 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.000032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.130850 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.138695 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-86d38ce1-73ba-474a-a947-703b2a171ec1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1367 microversion: 2.1 time: 0.151563 Aug 31 00:25:48.139267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 440/872] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:47 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:48.143222 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:48.143828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:48.150187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.150667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.151098 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.151783 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.152233 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.152654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.284393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.293465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a92ff4b7-91bc-4935-816a-18f62f520382 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1575 microversion: 2.1 time: 0.154519 Aug 31 00:25:48.294060 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 433/873] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:48 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:48.334920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:48.335533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:48.341638 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.342170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.342613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.343306 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:48.343765 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:48.344192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:48.471449 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.479559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.481011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:48.482212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a0abb635-7677-46d7-a97e-e95655cbf18a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.151176 Aug 31 00:25:48.482870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 441/874] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:48 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:49.160182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:49.160796 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:49.167557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.168031 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.168456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.169142 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.169582 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.170025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.286210 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-60b4de3b-4dcc-41ad-a9f4-675a0f5cebea req-cbad62e7-53ce-4453-bc21-5ee449ae1140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf2e097-da9b-4e83-a63c-bbd6fa880158", "name": "network-vif-plugged", "status": "completed", "tag": "6d187a0d-3cb9-4e2e-8bff-83480e41ed84"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:49.300942 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-60b4de3b-4dcc-41ad-a9f4-675a0f5cebea req-cbad62e7-53ce-4453-bc21-5ee449ae1140 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.301947 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-60b4de3b-4dcc-41ad-a9f4-675a0f5cebea req-cbad62e7-53ce-4453-bc21-5ee449ae1140 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.302559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-60b4de3b-4dcc-41ad-a9f4-675a0f5cebea req-cbad62e7-53ce-4453-bc21-5ee449ae1140 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.305262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.313204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a6056a87-abbc-4c88-b31b-a51d0da9c09e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1367 microversion: 2.1 time: 0.157183 Aug 31 00:25:49.314341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 434/875] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:49 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:49.319465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-60b4de3b-4dcc-41ad-a9f4-675a0f5cebea req-cbad62e7-53ce-4453-bc21-5ee449ae1140 service nova] Creating event network-vif-plugged:6d187a0d-3cb9-4e2e-8bff-83480e41ed84 for instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 on hv-cinder-85220 Aug 31 00:25:49.319631 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:49.320112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:49.325361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-60b4de3b-4dcc-41ad-a9f4-675a0f5cebea req-cbad62e7-53ce-4453-bc21-5ee449ae1140 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045636 Aug 31 00:25:49.326869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 442/876] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:49.327223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.327714 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.328150 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.328934 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.330005 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.330430 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.467809 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:49.476405 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6670be04-9adc-46a5-a6fc-397e21873df9 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1575 microversion: 2.1 time: 0.161065 Aug 31 00:25:49.477049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 435/877] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:49 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:49.507403 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:49.508106 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:49.514380 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.514864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.515300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:49.515989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:49.516441 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:49.517491 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.029693 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:50.038038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:50.039572 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:50.040821 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-adb66198-6908-4c52-98bd-b6a9e600d589 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.537807 Aug 31 00:25:50.041391 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 443/878] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:49 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:50.336309 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:50.337159 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:50.343634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.344112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.344549 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.345768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.346250 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.346672 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.474548 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-8c1f02cf-b805-46d3-bcc6-93c7374469b1 req-238a87e8-0e98-4135-a3f9-8c7d3ade6a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d7ee56-2da9-457b-86e3-bc28a16e747b", "name": "network-vif-deleted", "tag": "60491f5f-efbb-4927-ab3f-df70a22c8355"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:50.476916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:50.485924 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8c1f02cf-b805-46d3-bcc6-93c7374469b1 req-238a87e8-0e98-4135-a3f9-8c7d3ade6a83 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.486703 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8c1f02cf-b805-46d3-bcc6-93c7374469b1 req-238a87e8-0e98-4135-a3f9-8c7d3ade6a83 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.486896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7d97b008-269e-49dd-a71a-f44aff34cfa8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1367 microversion: 2.1 time: 0.154384 Aug 31 00:25:50.487406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 436/879] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:50 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:50.488067 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8c1f02cf-b805-46d3-bcc6-93c7374469b1 req-238a87e8-0e98-4135-a3f9-8c7d3ade6a83 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.498656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:50.502741 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:50.505750 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-8c1f02cf-b805-46d3-bcc6-93c7374469b1 req-238a87e8-0e98-4135-a3f9-8c7d3ade6a83 service nova] Creating event network-vif-deleted:60491f5f-efbb-4927-ab3f-df70a22c8355 for instance 17d7ee56-2da9-457b-86e3-bc28a16e747b on hv-cinder-85220 Aug 31 00:25:50.509884 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.510399 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.510840 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.511225 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-8c1f02cf-b805-46d3-bcc6-93c7374469b1 req-238a87e8-0e98-4135-a3f9-8c7d3ade6a83 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041605 Aug 31 00:25:50.511545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:50.512173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:50.512300 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 444/880] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:50.512620 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:50.581484 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:50.596454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8d7ab8d8-a402-4fe6-bb50-ea41c281a37f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1507 microversion: 2.1 time: 0.098895 Aug 31 00:25:50.599195 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 437/881] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:50 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1507 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:51.060848 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:51.061614 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=6 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:51.066673 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:51.067380 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:51.074625 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.075109 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.075547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.076231 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.076684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.077109 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.232904 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.245116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.246700 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.247961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-92c0f79c-4e0d-4028-893c-2a3b1fab7b69 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.188056 Aug 31 00:25:51.248618 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 445/882] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:51 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:51.508508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:51.509125 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:51.511664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=6 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:51.517352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.517828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.518281 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.518960 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.519414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.519834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.620367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:51.621116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:51.628179 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.628668 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.629111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.629810 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.630387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.630732 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.656463 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.662302 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.662795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.663235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.663691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lazy-loading 'fault' on Instance uuid 17d7ee56-2da9-457b-86e3-bc28a16e747b {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:25:51.664396 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bf6e5180-3aec-4306-b81a-776bb979b6f4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1556 microversion: 2.1 time: 0.159795 Aug 31 00:25:51.664979 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 438/883] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:51 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:51.685502 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-723aa6eb-f0d2-402b-97d7-aceff3624aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:51.686028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-723aa6eb-f0d2-402b-97d7-aceff3624aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:51.692691 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-723aa6eb-f0d2-402b-97d7-aceff3624aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.693176 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-723aa6eb-f0d2-402b-97d7-aceff3624aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.693614 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-723aa6eb-f0d2-402b-97d7-aceff3624aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.694345 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-723aa6eb-f0d2-402b-97d7-aceff3624aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:51.694800 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-723aa6eb-f0d2-402b-97d7-aceff3624aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:51.695225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-723aa6eb-f0d2-402b-97d7-aceff3624aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:51.709271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:51.717167 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d3c16b93-e3f4-49c6-9a3f-eae9b3227d80 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 200 len: 1230 microversion: 2.1 time: 0.100684 Aug 31 00:25:51.717746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 446/884] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:51 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:51.771715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-723aa6eb-f0d2-402b-97d7-aceff3624aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090011 Aug 31 00:25:51.772343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 439/885] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 31 00:25:51 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:25:52.271662 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:52.272266 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:52.278475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.278955 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.279392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.280077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.280529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.280955 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.410888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.419349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.420787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:52.421960 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8dd7b48e-61a2-4303-b97a-a2a1b65fa9fd tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.154285 Aug 31 00:25:52.422518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 447/886] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:52 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:52.709208 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-74ca325c-7fb6-4c68-b107-105c8ad532c3 req-b5fa7955-f3ae-415b-9417-a3cdaefae9ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf2e097-da9b-4e83-a63c-bbd6fa880158", "tag": "6d187a0d-3cb9-4e2e-8bff-83480e41ed84"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:52.720935 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-74ca325c-7fb6-4c68-b107-105c8ad532c3 req-b5fa7955-f3ae-415b-9417-a3cdaefae9ea service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.721532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-74ca325c-7fb6-4c68-b107-105c8ad532c3 req-b5fa7955-f3ae-415b-9417-a3cdaefae9ea service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.722227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-74ca325c-7fb6-4c68-b107-105c8ad532c3 req-b5fa7955-f3ae-415b-9417-a3cdaefae9ea service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.734936 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-74ca325c-7fb6-4c68-b107-105c8ad532c3 req-b5fa7955-f3ae-415b-9417-a3cdaefae9ea service nova] Creating event network-changed:6d187a0d-3cb9-4e2e-8bff-83480e41ed84 for instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 on hv-cinder-85220 Aug 31 00:25:52.738261 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:52.739530 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:52.740401 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-74ca325c-7fb6-4c68-b107-105c8ad532c3 req-b5fa7955-f3ae-415b-9417-a3cdaefae9ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036391 Aug 31 00:25:52.741080 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 440/887] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:52.746717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.747227 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.747656 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.748347 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:52.748795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:52.749216 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:52.763544 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] HTTP exception thrown: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Request method failure captured: Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b HTTP/1.1 Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqmZDWNgEzQZVG2e6-lzITfz_fDmkrocSPpoXIwlGL4FFXROum6O7eBrkYU6t7tTLuhLaLzLeUCcOxGSOa8e4tH5LBY97mfJ-R6VJeRsWakU6TtK-VhMPr0PtXX--zoAzpe1QGyiQSxqhR1GciQDgw1kelFNqHv7_VvuNb0TzKEKM2I Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:25:52.765445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-TestVolumeBootPattern-846706291 Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 5d8054341c0e46778e3b3db0b3dd1164 Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:25:52.767795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '17d7ee56-2da9-457b-86e3-bc28a16e747b'} Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:25:52.768864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:25:52.770405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:25:52.771798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Returning 404 to user: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:25:52.771798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c2d8c0b4-25fe-40a2-a357-523aa45ab282 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 404 len: 111 microversion: 2.1 time: 0.033572 Aug 31 00:25:52.772236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 448/888] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:52 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:25:52.874220 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-899866558", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-903737389", "security_groups": [{"name": "tempest-secgroup-smoke-1230119711"}], "block_device_mapping_v2": [{"uuid": "d55cede5-14ea-4f8c-8d2d-9eba4d8557af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4c2507f0-77f6-4977-b074-6f8caa46b647"}]}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:52.996303 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.network.neutron [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] validate_networks() for [('4c2507f0-77f6-4977-b074-6f8caa46b647', None, None, None, None, None)] {{(pid=132200) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:25:53.389494 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Flavor limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:25:53.390052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Image limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:25:53.390633 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Flavor pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:25:53.391383 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Image pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:25:53.392045 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:25:53.401516 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.402196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.402731 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.403883 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.404475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.405001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.423140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Getting quotas for project 167da5798ea2451a9888a661b3c7f3e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:25:53.428146 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Getting quotas for user 5d8054341c0e46778e3b3db0b3dd1164 and project 167da5798ea2451a9888a661b3c7f3e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:25:53.446166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:53.447643 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:53.455888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.456724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.457328 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.458256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:53.458873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:53.459549 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:53.505491 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Going to run 1 instances... {{(pid=132200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:25:53.507748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d55cede5-14ea-4f8c-8d2d-9eba4d8557af',volume_size=None,volume_type=None)] {{(pid=132200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:25:53.669077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4f9508be-0826-4c23-a9e2-51b79181e30d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798848 Aug 31 00:25:53.678017 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 441/889] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:25:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:25:53.684406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-27eb3e13-e426-4d8b-a6b8-1a00b0b4076c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:53.685277 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-27eb3e13-e426-4d8b-a6b8-1a00b0b4076c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:53.691823 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.702611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.704349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.706733 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-631f2912-4bae-445d-80bc-b0fa1fd5074d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.264840 Aug 31 00:25:53.707309 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 449/890] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:53 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:25:53.762032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-27eb3e13-e426-4d8b-a6b8-1a00b0b4076c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:53.770032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-27eb3e13-e426-4d8b-a6b8-1a00b0b4076c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1093 microversion: 2.1 time: 0.090107 Aug 31 00:25:53.771227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 442/891] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:53 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1093 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:54.734464 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:54.735687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:54.742425 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.742893 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.743335 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.744029 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.744481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.745006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.791292 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:54.792289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:54.800209 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.800699 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.801136 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.801831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:54.802326 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:54.802755 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:54.821322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:54.871404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:54.879787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-68932cf0-b7ab-4413-bed7-69999b44c56e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1191 microversion: 2.1 time: 0.092627 Aug 31 00:25:54.880541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 443/892] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:54 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:54.885306 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:54.893954 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:54.895384 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:54.896580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7fe58392-4d17-4beb-a81d-a118e14ac9b3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1745 microversion: 2.20 time: 0.166045 Aug 31 00:25:54.897133 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 450/893] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:54 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:55.900628 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:55.901239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:55.908241 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.909119 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.909119 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.909947 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.910422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.910919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.920711 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:55.922031 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:55.930195 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.931115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.931823 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.932763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.933432 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.934205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.977071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:55.986605 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-afcf7775-cb72-46aa-a108-dfbf380d08af tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1209 microversion: 2.1 time: 0.089518 Aug 31 00:25:55.987522 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 444/894] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:55 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:56.164109 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:56.173286 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:56.175437 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:56.176680 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0ae6573b-f6ea-4e3e-af80-48e232e4fe4d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1745 microversion: 2.20 time: 0.260400 Aug 31 00:25:56.177321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 451/895] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:55 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1745 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:56.755070 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-dfcd547d-5e8b-42e9-9348-b451be6c2727 req-5e81a5d2-6c75-4c48-8e30-ba802e71c80c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4", "tag": "8d1ea57b-30f1-4536-917c-3b6af1e48575"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:56.764407 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-dfcd547d-5e8b-42e9-9348-b451be6c2727 req-5e81a5d2-6c75-4c48-8e30-ba802e71c80c service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:56.764882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-dfcd547d-5e8b-42e9-9348-b451be6c2727 req-5e81a5d2-6c75-4c48-8e30-ba802e71c80c service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:56.765307 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-dfcd547d-5e8b-42e9-9348-b451be6c2727 req-5e81a5d2-6c75-4c48-8e30-ba802e71c80c service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:56.776576 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-dfcd547d-5e8b-42e9-9348-b451be6c2727 req-5e81a5d2-6c75-4c48-8e30-ba802e71c80c service nova] Creating event network-changed:8d1ea57b-30f1-4536-917c-3b6af1e48575 for instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 on hv-cinder-85220 Aug 31 00:25:56.782163 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-dfcd547d-5e8b-42e9-9348-b451be6c2727 req-5e81a5d2-6c75-4c48-8e30-ba802e71c80c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031252 Aug 31 00:25:56.783037 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 445/896] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:25:57.008129 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:57.008756 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:57.016069 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:57.016582 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:57.017008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.017704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:57.018181 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:57.018806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.202370 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:57.203658 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:57.212869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:57.213351 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:57.213784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.214579 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:57.215027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:57.215808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:57.225949 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:57.234378 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8bd22485-ab1f-4cdf-8e7c-96b305db6d3f tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.230127 Aug 31 00:25:57.247554 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 452/897] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:57 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:25:57.361320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:57.370476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:57.371914 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:57.373109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b4313702-0cab-466e-a2b4-071b1acda388 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1745 microversion: 2.20 time: 0.176349 Aug 31 00:25:57.373667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 446/898] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:57 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:58.254794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:58.255408 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:58.261958 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.262438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.262874 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.263566 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.264019 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.264440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.400704 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:58.402217 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:58.405689 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.410082 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.410602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.411152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.411901 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.412853 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.413339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.417632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a644eff8-03db-4505-885c-338f3b3040b7 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.167196 Aug 31 00:25:58.418653 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 453/899] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:58 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:58.577337 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.587002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.588719 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:58.590960 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6c24779d-2212-4d6e-b19c-58a440d69fe4 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1740 microversion: 2.20 time: 0.195382 Aug 31 00:25:58.591532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 447/900] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:58 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:25:58.965724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c62e696d-0ea6-43fd-aecd-b7fcac41019b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:58.966240 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c62e696d-0ea6-43fd-aecd-b7fcac41019b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:58.968183 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:58.976925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c62e696d-0ea6-43fd-aecd-b7fcac41019b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.977714 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c62e696d-0ea6-43fd-aecd-b7fcac41019b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.978186 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c62e696d-0ea6-43fd-aecd-b7fcac41019b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.978903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c62e696d-0ea6-43fd-aecd-b7fcac41019b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:58.979359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c62e696d-0ea6-43fd-aecd-b7fcac41019b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:58.979788 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c62e696d-0ea6-43fd-aecd-b7fcac41019b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:58.984955 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:59.014092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c62e696d-0ea6-43fd-aecd-b7fcac41019b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/ips" status: 200 len: 146 microversion: 2.1 time: 0.052363 Aug 31 00:25:59.014674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 454/901] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:25:58 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:59.334898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-34667bcc-1d60-4bc1-8536-0cb9323d63c0 req-3376d33e-f2d1-4041-8276-618ccd325f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd646c5-f435-4d57-acb3-1ceb01a56868", "name": "network-vif-plugged", "status": "completed", "tag": "3f18d97a-669b-4781-8b9e-7428a4c4fbda"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:25:59.350369 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-34667bcc-1d60-4bc1-8536-0cb9323d63c0 req-3376d33e-f2d1-4041-8276-618ccd325f26 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.351039 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-34667bcc-1d60-4bc1-8536-0cb9323d63c0 req-3376d33e-f2d1-4041-8276-618ccd325f26 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.351664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-34667bcc-1d60-4bc1-8536-0cb9323d63c0 req-3376d33e-f2d1-4041-8276-618ccd325f26 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.364567 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-34667bcc-1d60-4bc1-8536-0cb9323d63c0 req-3376d33e-f2d1-4041-8276-618ccd325f26 service nova] Creating event network-vif-plugged:3f18d97a-669b-4781-8b9e-7428a4c4fbda for instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 on hv-cinder-85220 Aug 31 00:25:59.373284 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-34667bcc-1d60-4bc1-8536-0cb9323d63c0 req-3376d33e-f2d1-4041-8276-618ccd325f26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042226 Aug 31 00:25:59.374541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 448/902] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:59.438870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:59.440187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:59.449037 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.449882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.450598 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.451679 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.452568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.453256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.614852 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.618819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:59.620513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:25:59.622850 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:59.624162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2bb0fb96-61af-44a8-a3c0-428cc890068b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.189534 Aug 31 00:25:59.624746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 455/903] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:25:59 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:25:59.631531 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.632028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.632460 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.633346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:59.633802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:59.634256 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:59.779887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.790099 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.791671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:25:59.793320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6a8296de-6735-4cc1-acd7-5ef7810db960 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1740 microversion: 2.20 time: 0.181726 Aug 31 00:25:59.806019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 449/904] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:25:59 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:00.458475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2f02c1a4-41b0-41f9-b7dd-c571a7809bd6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3fce2df-c1a5-444a-998d-573af536d345"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:00.461080 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2f02c1a4-41b0-41f9-b7dd-c571a7809bd6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:00.471035 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f02c1a4-41b0-41f9-b7dd-c571a7809bd6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.471383 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f02c1a4-41b0-41f9-b7dd-c571a7809bd6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.471818 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f02c1a4-41b0-41f9-b7dd-c571a7809bd6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.472547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f02c1a4-41b0-41f9-b7dd-c571a7809bd6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.472998 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f02c1a4-41b0-41f9-b7dd-c571a7809bd6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.473419 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2f02c1a4-41b0-41f9-b7dd-c571a7809bd6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.644821 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:00.646120 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:00.653033 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.653753 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.654218 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.654952 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.655412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.655826 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.818628 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2f02c1a4-41b0-41f9-b7dd-c571a7809bd6 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363915 Aug 31 00:26:00.824671 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 456/905] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:26:00 2022] POST /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:00.827985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:00.829089 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:00.837196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:00.848153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ad0650d8-0593-48f5-b7dc-4b0b2cb1e251 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.206531 Aug 31 00:26:00.849375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 450/906] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:00 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:00.860380 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.861298 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.862741 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:00.863620 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:00.864533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:00.865810 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:01.053670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:01.062166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:01.064282 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:01.065490 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1155693c-0c2a-4d60-9c68-481e335f3b9e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1740 microversion: 2.20 time: 0.244448 Aug 31 00:26:01.066083 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 457/907] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:00 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:01.874756 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:01.876708 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:01.884525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:01.885012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:01.885658 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:01.886398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:01.887338 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:01.887957 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.063357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.072168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a66051e0-5b3e-4a57-948f-36f571e00a37 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.207379 Aug 31 00:26:02.072840 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 451/908] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:01 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:02.089342 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:02.090082 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:02.097655 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.098633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.099266 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.100136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:02.100770 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:02.101210 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:02.243006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.252281 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.254077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:02.255253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8cd7accb-2502-40dd-af4a-7b0525a520e3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1740 microversion: 2.20 time: 0.170490 Aug 31 00:26:02.270389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 458/909] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:02 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:03.096186 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:03.099772 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:03.107774 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.108350 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.109054 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:03.110578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.111213 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.111708 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:03.270738 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:03.280834 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:03.282712 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:03.285527 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8bc82a5f-99dc-48f6-a1bb-bf2e90e4a298 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.193819 Aug 31 00:26:03.286882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 452/910] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:03 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:03.291206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.292026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.292704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:03.293821 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:03.294517 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:03.295141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:03.484520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:03.501190 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:03.503005 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:03.504264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1e16febe-c2a6-4f89-b822-f1abd8495ca5 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1740 microversion: 2.20 time: 0.228120 Aug 31 00:26:03.505021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 459/911] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:03 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:04.308834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:04.309476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:04.315281 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:04.316307 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=8 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:04.318737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:04.319456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:04.320069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:04.320810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:04.321445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:04.321901 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:04.472860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:04.483751 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e8ce3779-8d0a-470d-be27-15fa2edd41e4 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.178785 Aug 31 00:26:04.497665 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 453/912] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:04 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:04.528552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:04.529398 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:04.536269 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:04.536976 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:04.537637 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:04.538567 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:04.539241 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:04.540130 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:04.688100 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:04.696983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:04.698479 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:04.699685 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-54e5a5b6-753c-4986-97d2-3e9e0b905d79 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1740 microversion: 2.20 time: 0.175099 Aug 31 00:26:04.710287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 460/913] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:04 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:05.505361 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:05.505987 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:05.512590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.513064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.513764 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.514727 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.515395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.516109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.723825 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:05.725266 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:05.741296 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.742164 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.742853 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.743651 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:05.744203 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:05.744713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:05.835532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:05.845874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ba9b4f0e-d426-42f4-9657-9ac3d16d5697 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.344200 Aug 31 00:26:05.847298 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 454/914] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:05 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:05.912314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:05.921534 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:05.923748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:05.925120 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-082c87ec-15fe-4612-92e3-5c7a8cd9c98b tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1740 microversion: 2.20 time: 0.205493 Aug 31 00:26:05.926320 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 461/915] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:05 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:06.867051 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:06.868400 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:06.876688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:06.877366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:06.877972 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:06.878942 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:06.879558 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:06.880140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:06.949081 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:06.950341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:06.957954 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:06.958695 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:06.959303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:06.960204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:06.960824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:06.961422 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.052448 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:07.060850 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-65ef3d35-bdfb-49d1-80f1-547e8bf4b462 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.197624 Aug 31 00:26:07.061431 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 455/916] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:06 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:07.110948 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:07.122698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:07.124562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:07.125987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-24986869-ad1e-495c-8373-b183b6a760e9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1740 microversion: 2.20 time: 0.180887 Aug 31 00:26:07.138724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 462/917] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:06 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:07.432228 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-043b32e9-05b4-4cac-958c-eef65d7be590 req-01c15c6a-ef26-46ce-8d28-1b7f32c2addd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4", "name": "network-vif-plugged", "status": "completed", "tag": "8d1ea57b-30f1-4536-917c-3b6af1e48575"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:07.442691 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-043b32e9-05b4-4cac-958c-eef65d7be590 req-01c15c6a-ef26-46ce-8d28-1b7f32c2addd service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:07.443177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-043b32e9-05b4-4cac-958c-eef65d7be590 req-01c15c6a-ef26-46ce-8d28-1b7f32c2addd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:07.443672 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-043b32e9-05b4-4cac-958c-eef65d7be590 req-01c15c6a-ef26-46ce-8d28-1b7f32c2addd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:07.456518 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-043b32e9-05b4-4cac-958c-eef65d7be590 req-01c15c6a-ef26-46ce-8d28-1b7f32c2addd service nova] Creating event network-vif-plugged:8d1ea57b-30f1-4536-917c-3b6af1e48575 for instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 on hv-cinder-85220 Aug 31 00:26:07.461676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-043b32e9-05b4-4cac-958c-eef65d7be590 req-01c15c6a-ef26-46ce-8d28-1b7f32c2addd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034384 Aug 31 00:26:07.462594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 456/918] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:08.081315 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:08.081808 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:08.089706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.090319 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.090920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:08.091708 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.092168 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.092601 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:08.151316 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:08.152105 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:08.158928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.159491 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.160006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:08.160793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:08.161324 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:08.161826 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:08.229178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:08.237690 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bbb195fb-6217-4650-a287-70ef41676021 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.160844 Aug 31 00:26:08.238550 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 463/919] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:08 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:08.292611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:08.301256 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:08.302739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:08.303902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-13b0834b-0a9c-488b-aa71-6c50693d041c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1740 microversion: 2.20 time: 0.157356 Aug 31 00:26:08.304458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 457/920] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:08 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:09.258629 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:09.259246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:09.267337 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.267821 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.268260 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.268952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.269565 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.270386 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.327197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:09.327825 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:09.334307 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.334789 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.335225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.335923 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.336380 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.336801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.402355 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:09.411296 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-217259ca-e226-429b-bf6a-9ee343879465 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.156582 Aug 31 00:26:09.417903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 464/921] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:09 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:09.466131 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:09.474712 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:09.476152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:09.477298 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-217cb5d9-c788-44e0-af08-30cf4a8353c3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1722 microversion: 2.20 time: 0.154119 Aug 31 00:26:09.477875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 458/922] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:09 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:09.518093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8baebe91-c7bd-4c8c-a98a-9ac61f1122a1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:09.520652 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8baebe91-c7bd-4c8c-a98a-9ac61f1122a1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:09.526843 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8baebe91-c7bd-4c8c-a98a-9ac61f1122a1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.527317 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8baebe91-c7bd-4c8c-a98a-9ac61f1122a1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.527750 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8baebe91-c7bd-4c8c-a98a-9ac61f1122a1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.528459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8baebe91-c7bd-4c8c-a98a-9ac61f1122a1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.528911 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8baebe91-c7bd-4c8c-a98a-9ac61f1122a1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.529331 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8baebe91-c7bd-4c8c-a98a-9ac61f1122a1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.559661 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8baebe91-c7bd-4c8c-a98a-9ac61f1122a1 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Aug 31 00:26:09.560474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 465/923] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:26:09 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:09.571327 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ca71b7d9-2e79-4c29-82d5-7f0d473b370c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:09.571841 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ca71b7d9-2e79-4c29-82d5-7f0d473b370c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:09.578808 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ca71b7d9-2e79-4c29-82d5-7f0d473b370c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.579225 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ca71b7d9-2e79-4c29-82d5-7f0d473b370c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.579656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ca71b7d9-2e79-4c29-82d5-7f0d473b370c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.580342 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ca71b7d9-2e79-4c29-82d5-7f0d473b370c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:09.580786 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ca71b7d9-2e79-4c29-82d5-7f0d473b370c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:09.581202 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ca71b7d9-2e79-4c29-82d5-7f0d473b370c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:09.610010 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ca71b7d9-2e79-4c29-82d5-7f0d473b370c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/a3fce2df-c1a5-444a-998d-573af536d345" status: 200 len: 194 microversion: 2.1 time: 0.042651 Aug 31 00:26:09.610601 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 459/924] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 31 00:26:09 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/a3fce2df-c1a5-444a-998d-573af536d345 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:10.432258 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:10.432796 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:10.439870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.440301 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.440737 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.441424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.441900 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.442332 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.501291 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:10.502096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:10.508700 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.509260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.509802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.510612 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.511143 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.511642 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.577933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:10.586186 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c690b56d-646b-43ab-ac60-a4354a9d5b68 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1265 microversion: 2.1 time: 0.157845 Aug 31 00:26:10.586762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 466/925] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:10 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:10.941508 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5ae12d5d-6556-4dd9-ba7b-d9cd97044d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ff5fbd6-4552-442d-b419-90df2db9e73c"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:10.944074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5ae12d5d-6556-4dd9-ba7b-d9cd97044d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:10.950395 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ae12d5d-6556-4dd9-ba7b-d9cd97044d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.950893 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ae12d5d-6556-4dd9-ba7b-d9cd97044d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.951336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ae12d5d-6556-4dd9-ba7b-d9cd97044d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.952049 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ae12d5d-6556-4dd9-ba7b-d9cd97044d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:10.952507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ae12d5d-6556-4dd9-ba7b-d9cd97044d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:10.952939 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5ae12d5d-6556-4dd9-ba7b-d9cd97044d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:10.976538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:10.986198 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:10.987815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:10.989193 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b5cb3cb6-d17a-469d-a8ba-a26e963024a9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1722 microversion: 2.20 time: 0.492323 Aug 31 00:26:10.990104 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 460/926] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:10 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1722 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:11.606965 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:11.607642 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:11.614596 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.615077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.615508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.616196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.616650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.617070 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.744162 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:11.751846 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-89e7ce7c-28d9-41a5-b41d-3db7961b67d3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1452 microversion: 2.1 time: 0.148854 Aug 31 00:26:11.752409 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 461/927] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:11 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:11.771212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:11.771839 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:11.777539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.778063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.778530 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.779223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:11.779677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:11.780098 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:11.784665 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:11.913513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:11.921476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b5bbaf26-467f-4204-bfc8-74affd2e4d16 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1452 microversion: 2.1 time: 0.153777 Aug 31 00:26:11.922595 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 462/928] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:11 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:26:12.014404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:12.015014 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:12.020926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:12.021414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:12.021868 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:12.022584 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:12.023041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:12.023468 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:12.236121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:12.244305 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:12.245751 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:12.246955 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-aecb12c1-a72d-4068-a12b-521be82a5963 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1722 microversion: 2.20 time: 0.236426 Aug 31 00:26:12.247519 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 463/929] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:12 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:13.272690 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:13.273335 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:13.279818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.280387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.280898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.281679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.282244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.282736 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.491318 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:13.499713 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:13.501764 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:13.503146 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6090ea92-9027-4170-862a-8038f72e59af tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1722 microversion: 2.20 time: 0.235084 Aug 31 00:26:13.503703 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 464/930] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:13 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:13.522815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-9f3c6eba-ce8e-4ba0-afdc-0adffdf3786e req-d08ed4d1-d8d7-49fc-bbd1-478655b5c45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd646c5-f435-4d57-acb3-1ceb01a56868", "name": "network-vif-unplugged", "status": "completed", "tag": "3f18d97a-669b-4781-8b9e-7428a4c4fbda"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:13.531885 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-9f3c6eba-ce8e-4ba0-afdc-0adffdf3786e req-d08ed4d1-d8d7-49fc-bbd1-478655b5c45d service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.532561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-9f3c6eba-ce8e-4ba0-afdc-0adffdf3786e req-d08ed4d1-d8d7-49fc-bbd1-478655b5c45d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.532996 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-9f3c6eba-ce8e-4ba0-afdc-0adffdf3786e req-d08ed4d1-d8d7-49fc-bbd1-478655b5c45d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.544243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-9f3c6eba-ce8e-4ba0-afdc-0adffdf3786e req-d08ed4d1-d8d7-49fc-bbd1-478655b5c45d service nova] Creating event network-vif-unplugged:3f18d97a-669b-4781-8b9e-7428a4c4fbda for instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 on hv-cinder-85220 Aug 31 00:26:13.549723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-9f3c6eba-ce8e-4ba0-afdc-0adffdf3786e req-d08ed4d1-d8d7-49fc-bbd1-478655b5c45d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030709 Aug 31 00:26:13.550573 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 465/931] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:13.651579 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-41d0aadf-677f-4f11-84b0-8ba58d089965 req-4123e6d1-a799-40f9-99c0-244280b76190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4", "tag": "8d1ea57b-30f1-4536-917c-3b6af1e48575"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:13.661636 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-41d0aadf-677f-4f11-84b0-8ba58d089965 req-4123e6d1-a799-40f9-99c0-244280b76190 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:13.662224 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-41d0aadf-677f-4f11-84b0-8ba58d089965 req-4123e6d1-a799-40f9-99c0-244280b76190 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:13.662735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-41d0aadf-677f-4f11-84b0-8ba58d089965 req-4123e6d1-a799-40f9-99c0-244280b76190 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:13.673873 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-41d0aadf-677f-4f11-84b0-8ba58d089965 req-4123e6d1-a799-40f9-99c0-244280b76190 service nova] Creating event network-changed:8d1ea57b-30f1-4536-917c-3b6af1e48575 for instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 on hv-cinder-85220 Aug 31 00:26:13.678777 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-41d0aadf-677f-4f11-84b0-8ba58d089965 req-4123e6d1-a799-40f9-99c0-244280b76190 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031394 Aug 31 00:26:13.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 466/932] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:14.399752 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5ae12d5d-6556-4dd9-ba7b-d9cd97044d4d tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "POST /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.462526 Aug 31 00:26:14.400608 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 467/933] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:26:10 2022] POST /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments => generated 194 bytes in 3464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:26:14.531637 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:14.532343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:14.547437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:14.548483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:14.551602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:14.552383 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:14.552861 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:14.553294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:14.784110 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:14.793096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:14.794698 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:14.795883 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-53f45596-4189-42c7-8b2e-a9f6690be8fc tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1725 microversion: 2.20 time: 0.269395 Aug 31 00:26:14.796440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 467/934] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:14 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1725 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:14.820761 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cd712dce-ee27-4837-8bc1-855cff494ec2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "977941ea-0fd0-49d4-937d-b53b80c64885"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:14.824229 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cd712dce-ee27-4837-8bc1-855cff494ec2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:14.831563 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd712dce-ee27-4837-8bc1-855cff494ec2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:14.832075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd712dce-ee27-4837-8bc1-855cff494ec2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:14.832566 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd712dce-ee27-4837-8bc1-855cff494ec2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:14.833274 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd712dce-ee27-4837-8bc1-855cff494ec2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:14.833724 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd712dce-ee27-4837-8bc1-855cff494ec2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:14.834178 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd712dce-ee27-4837-8bc1-855cff494ec2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:14.852168 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:15.133383 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cd712dce-ee27-4837-8bc1-855cff494ec2 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317485 Aug 31 00:26:15.134541 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 468/935] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 31 00:26:14 2022] POST /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:26:15.276304 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f45f7deb-d4d8-4f0b-9d3a-42a57b5fc2d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:15.276797 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f45f7deb-d4d8-4f0b-9d3a-42a57b5fc2d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:15.283580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f45f7deb-d4d8-4f0b-9d3a-42a57b5fc2d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:15.283813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f45f7deb-d4d8-4f0b-9d3a-42a57b5fc2d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:15.284243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f45f7deb-d4d8-4f0b-9d3a-42a57b5fc2d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:15.285364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f45f7deb-d4d8-4f0b-9d3a-42a57b5fc2d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:15.285464 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f45f7deb-d4d8-4f0b-9d3a-42a57b5fc2d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:15.285819 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f45f7deb-d4d8-4f0b-9d3a-42a57b5fc2d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:15.556507 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f45f7deb-d4d8-4f0b-9d3a-42a57b5fc2d8 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/os-volume_attachments/977941ea-0fd0-49d4-937d-b53b80c64885" status: 202 len: 0 microversion: 2.20 time: 0.283904 Aug 31 00:26:15.557200 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 468/936] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 31 00:26:15 2022] DELETE /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/os-volume_attachments/977941ea-0fd0-49d4-937d-b53b80c64885 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:26:15.616048 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:15.616651 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:15.623787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:15.624269 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:15.624742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:15.625433 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:15.625925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:15.626351 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:15.655865 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132201) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:26:15.721783 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0c8661b8-500a-4286-937d-dd9cd1242c15 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "POST /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/action" status: 202 len: 0 microversion: 2.20 time: 0.109134 Aug 31 00:26:15.722311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 469/937] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 31 00:26:15 2022] POST /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:26:15.730169 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:15.730784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:15.738722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:15.739241 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:15.739685 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:15.740388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:15.740844 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:15.741269 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:15.887378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:15.896169 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:15.897609 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:15.898794 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e95dbc19-9e88-4cec-a7fd-5fab6aca9a09 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1673 microversion: 2.20 time: 0.172492 Aug 31 00:26:15.899402 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 469/938] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:15 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:16.923481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:16.924192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:16.930985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:16.931574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:16.932015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:16.932706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:16.933159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:16.933592 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:17.063159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:17.071458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:17.072914 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:17.074114 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-af6a6a4b-763a-4d70-89b3-00d2501fb491 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.155305 Aug 31 00:26:17.074670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 470/939] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:16 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:18.096416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:18.097011 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:18.103916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:18.104407 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:18.104894 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:18.105541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:18.106078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:18.106607 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:18.308822 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:18.321245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:18.323146 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:18.324769 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f41996c8-1d62-4eb1-b324-9612c34a7949 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.232199 Aug 31 00:26:18.338411 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 470/940] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:18 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:19.351844 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:19.352435 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:19.358999 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:19.359483 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:19.359920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:19.360613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:19.361070 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:19.361499 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:19.497823 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:19.507125 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:19.508870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:19.510284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c8ac2ec7-4be2-4cda-b81e-5167be254acb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.162394 Aug 31 00:26:19.523800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 471/941] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:19 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:20.534911 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:20.535611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:20.542624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:20.543853 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:20.543853 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:20.546020 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:20.547297 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:20.547880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:20.685453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:20.694104 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:20.695537 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:20.696686 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-05ae682b-feb0-4452-ab9d-23791dd71e0c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.166161 Aug 31 00:26:20.697243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 471/942] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:20 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:21.720945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:21.721485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:21.728569 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:21.729163 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:21.729669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:21.730485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:21.731007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:21.731504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:21.871437 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:21.879782 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:21.881381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:21.882601 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c3aa9017-da4f-44e2-8d91-6bc13cd5909d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.166380 Aug 31 00:26:21.883301 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 472/943] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:21 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:22.906376 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:22.907008 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:22.913359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:22.913970 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:22.914501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:22.915644 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:22.916665 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:22.917456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:23.064879 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:23.072980 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:23.074445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:23.075603 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-55daaff3-dda6-46b7-b73b-8d08e1af6473 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.173656 Aug 31 00:26:23.076151 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 472/944] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:22 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:24.099957 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:24.100555 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:24.107990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:24.109230 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:24.109659 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:24.110550 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:24.111156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:24.111732 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:24.257131 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:24.266581 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:24.268110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:24.269283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b6e4ab8e-e58a-44c5-a466-91be68a1424d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.173263 Aug 31 00:26:24.269900 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 473/945] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:24 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:25.295094 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:25.295813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:25.302602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:25.303094 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:25.303536 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:25.304412 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:25.304879 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:25.305472 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:25.444511 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:25.452841 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:25.454337 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:25.455508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-67b9e8cf-5bf4-4b6b-aa44-a6b45846e9c7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.166230 Aug 31 00:26:25.456068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 473/946] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:25 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:26.478758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:26.479366 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:26.486318 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:26.487064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:26.487501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:26.488390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:26.489013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:26.489629 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:26.628910 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:26.637583 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:26.639465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:26.640846 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e3368ebc-c918-4d83-a485-caf6a0b1f52e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.166343 Aug 31 00:26:26.641899 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 474/947] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:26 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:27.664748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:27.665406 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:27.672148 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:27.672630 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:27.673063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:27.673750 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:27.674234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:27.674660 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:27.826768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:27.835423 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:27.836883 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:27.838081 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-33ed7ac8-9bf4-4fc2-b6e9-6c359aa820b9 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.177293 Aug 31 00:26:27.838642 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 474/948] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:27 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:28.862856 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:28.863405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:28.870311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:28.870809 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:28.871247 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:28.871957 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:28.872409 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:28.872876 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:29.007972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:29.016158 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:29.017617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:29.018806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e7c554b0-0283-4b92-a566-cdc52d6ba00a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.160720 Aug 31 00:26:29.019369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 475/949] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:28 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:30.042852 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:30.043456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:30.046436 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=52 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:30.051562 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:30.052038 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:30.052467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:30.053147 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:30.053593 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:30.054043 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:30.187275 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:30.195320 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:30.196756 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:30.197927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e4d11de0-de7a-4d52-a078-5a243c6a4b29 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.159192 Aug 31 00:26:30.198483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 475/950] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:30 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:31.220910 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:31.221429 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:31.223819 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:31.229166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:31.229641 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:31.230177 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:31.230869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:31.231317 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:31.231740 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:31.358498 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:31.366605 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:31.368047 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:31.369202 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-67cfa3e9-710e-4db1-8ad9-c9f10b82b450 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.152481 Aug 31 00:26:31.369760 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 476/951] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:31 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:32.393031 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:32.393688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:32.399998 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.400476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.400909 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.401597 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.402080 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.402505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.535082 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:32.544083 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:32.545650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:32.546827 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-73956ec9-68ff-4773-9849-13b0a7d49e1d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.158290 Aug 31 00:26:32.547391 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 476/952] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:32 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:32.579250 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-72b05c60-c5f6-4bd2-b9c5-7b08ab821170 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:32.581507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-72b05c60-c5f6-4bd2-b9c5-7b08ab821170 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:32.587989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72b05c60-c5f6-4bd2-b9c5-7b08ab821170 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.588475 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72b05c60-c5f6-4bd2-b9c5-7b08ab821170 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.588914 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72b05c60-c5f6-4bd2-b9c5-7b08ab821170 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.589607 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72b05c60-c5f6-4bd2-b9c5-7b08ab821170 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.590095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72b05c60-c5f6-4bd2-b9c5-7b08ab821170 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.590531 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-72b05c60-c5f6-4bd2-b9c5-7b08ab821170 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.620756 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-72b05c60-c5f6-4bd2-b9c5-7b08ab821170 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046093 Aug 31 00:26:32.621311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 477/953] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:26:32 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:32.770550 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ae46383a-1862-4bc6-bc75-3ce0a1c6313c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:32.771045 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ae46383a-1862-4bc6-bc75-3ce0a1c6313c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:32.777034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae46383a-1862-4bc6-bc75-3ce0a1c6313c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.777519 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae46383a-1862-4bc6-bc75-3ce0a1c6313c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.777982 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae46383a-1862-4bc6-bc75-3ce0a1c6313c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.778678 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae46383a-1862-4bc6-bc75-3ce0a1c6313c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.779128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae46383a-1862-4bc6-bc75-3ce0a1c6313c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.779549 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ae46383a-1862-4bc6-bc75-3ce0a1c6313c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.797247 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:32.812398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ae46383a-1862-4bc6-bc75-3ce0a1c6313c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/a3fce2df-c1a5-444a-998d-573af536d345" status: 200 len: 194 microversion: 2.1 time: 0.045846 Aug 31 00:26:32.812976 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 477/954] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 31 00:26:32 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/a3fce2df-c1a5-444a-998d-573af536d345 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:32.823139 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:32.823632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:32.829613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.830124 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.830561 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.831242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:32.831693 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:32.832117 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:32.913363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lazy-loading 'services' on Instance uuid 75a68b76-10b6-44b6-b459-9b5c469bb0b7 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:32.987436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-015e32c8-bf22-45d5-b41c-9c296cc4893c tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/a3fce2df-c1a5-444a-998d-573af536d345" status: 202 len: 0 microversion: 2.1 time: 0.168030 Aug 31 00:26:32.988230 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 478/955] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:26:32 2022] DELETE /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/a3fce2df-c1a5-444a-998d-573af536d345 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:26:33.570525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:33.571072 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:33.582034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:33.582034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:33.582034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:33.582034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:33.582619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:33.582619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:33.711080 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:33.720515 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:33.722179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:33.723333 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d27ca5e5-78d4-41ad-aa78-a52e3791f493 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.157092 Aug 31 00:26:33.723887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 478/956] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:33 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:34.748074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:34.749426 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:34.756363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:34.756847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:34.757287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:34.758057 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:34.758512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:34.758938 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:34.890866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:34.899543 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:34.900982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:34.902174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3c2a83b1-02ce-49d2-8def-1229198fb60d tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.159063 Aug 31 00:26:34.902732 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 479/957] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:34 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:35.167671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9e474d5c-fac6-4b26-a2eb-85fc343ac221 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:35.168200 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9e474d5c-fac6-4b26-a2eb-85fc343ac221 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:35.175104 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e474d5c-fac6-4b26-a2eb-85fc343ac221 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.175590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e474d5c-fac6-4b26-a2eb-85fc343ac221 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.176027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e474d5c-fac6-4b26-a2eb-85fc343ac221 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.176722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e474d5c-fac6-4b26-a2eb-85fc343ac221 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.177179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e474d5c-fac6-4b26-a2eb-85fc343ac221 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.177611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9e474d5c-fac6-4b26-a2eb-85fc343ac221 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.206383 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9e474d5c-fac6-4b26-a2eb-85fc343ac221 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/7ff5fbd6-4552-442d-b419-90df2db9e73c" status: 200 len: 194 microversion: 2.1 time: 0.042968 Aug 31 00:26:35.206960 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 479/958] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 31 00:26:35 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/7ff5fbd6-4552-442d-b419-90df2db9e73c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:35.217422 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:35.217960 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:35.223805 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.224289 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.224734 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.225421 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.225897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.226330 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.301935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.306287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lazy-loading 'services' on Instance uuid 75a68b76-10b6-44b6-b459-9b5c469bb0b7 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:35.379729 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3ee720eb-f51c-44c7-a936-c9c56fb705bd tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/7ff5fbd6-4552-442d-b419-90df2db9e73c" status: 202 len: 0 microversion: 2.1 time: 0.166266 Aug 31 00:26:35.380512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 480/959] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:26:35 2022] DELETE /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments/7ff5fbd6-4552-442d-b419-90df2db9e73c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:26:35.492531 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-3fe30604-bfc5-4853-a361-6ee777ce3b48 req-83337310-e0f3-498f-8c78-aa6f59e27f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd646c5-f435-4d57-acb3-1ceb01a56868", "name": "network-vif-plugged", "status": "completed", "tag": "3f18d97a-669b-4781-8b9e-7428a4c4fbda"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:35.502664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3fe30604-bfc5-4853-a361-6ee777ce3b48 req-83337310-e0f3-498f-8c78-aa6f59e27f38 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.503445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3fe30604-bfc5-4853-a361-6ee777ce3b48 req-83337310-e0f3-498f-8c78-aa6f59e27f38 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.503866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3fe30604-bfc5-4853-a361-6ee777ce3b48 req-83337310-e0f3-498f-8c78-aa6f59e27f38 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.516891 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-3fe30604-bfc5-4853-a361-6ee777ce3b48 req-83337310-e0f3-498f-8c78-aa6f59e27f38 service nova] Creating event network-vif-plugged:3f18d97a-669b-4781-8b9e-7428a4c4fbda for instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 on hv-cinder-85220 Aug 31 00:26:35.521794 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-3fe30604-bfc5-4853-a361-6ee777ce3b48 req-83337310-e0f3-498f-8c78-aa6f59e27f38 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032797 Aug 31 00:26:35.522610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 480/960] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:35.927081 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:35.927776 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:35.933977 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.934455 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.934891 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:35.935573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:35.936024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:35.936448 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:36.073786 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:36.083051 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:36.084594 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:36.085753 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-170fb748-6b9c-4766-8ec8-0addcc74ea45 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.163665 Aug 31 00:26:36.086348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 481/961] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:35 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:37.110152 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:37.110880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:37.117065 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.117539 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.118012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.118737 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.119138 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.119557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.250919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:37.259468 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:37.260943 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:37.262210 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0f786376-4d93-45ef-8218-9a80aafcbd8c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.157388 Aug 31 00:26:37.262777 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 481/962] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:37 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:37.606571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ec2aec62-590f-47de-b378-5e26e678252b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:37.608869 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ec2aec62-590f-47de-b378-5e26e678252b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:37.615256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ec2aec62-590f-47de-b378-5e26e678252b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.615749 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ec2aec62-590f-47de-b378-5e26e678252b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.616164 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ec2aec62-590f-47de-b378-5e26e678252b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.616844 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ec2aec62-590f-47de-b378-5e26e678252b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.617290 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ec2aec62-590f-47de-b378-5e26e678252b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.617707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ec2aec62-590f-47de-b378-5e26e678252b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.646833 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ec2aec62-590f-47de-b378-5e26e678252b tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044245 Aug 31 00:26:37.647387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 482/963] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:26:37 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:26:37.768680 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e8b87153-b5db-4d70-9f79-8657027c0615 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:37.771048 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e8b87153-b5db-4d70-9f79-8657027c0615 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:37.777035 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8b87153-b5db-4d70-9f79-8657027c0615 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.777523 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8b87153-b5db-4d70-9f79-8657027c0615 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.778017 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8b87153-b5db-4d70-9f79-8657027c0615 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.778717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8b87153-b5db-4d70-9f79-8657027c0615 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.779181 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8b87153-b5db-4d70-9f79-8657027c0615 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.779609 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e8b87153-b5db-4d70-9f79-8657027c0615 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.814508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e8b87153-b5db-4d70-9f79-8657027c0615 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049995 Aug 31 00:26:37.815069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 482/964] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:26:37 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:26:37.874917 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:37.875408 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:37.881357 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.881837 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.882696 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.882969 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:37.883419 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:37.883837 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:37.910661 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:26:37.987520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6f80e807-51de-48b4-ac58-44c403147803 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 204 len: 0 microversion: 2.1 time: 0.116632 Aug 31 00:26:37.988234 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 483/965] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:26:37 2022] DELETE /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:26:37.997037 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:37.997655 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:38.004525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.004894 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.005331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.006156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.006616 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.007046 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.146735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:38.154726 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-74a74607-1e5a-4ac6-90b9-273bb8933347 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1674 microversion: 2.1 time: 0.161947 Aug 31 00:26:38.155418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 483/966] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:37 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:38.286668 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:38.287294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:38.293587 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.294103 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.294634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.295817 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:38.296267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:38.296692 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:38.430242 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:38.439054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:38.440510 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:38.441682 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9d603005-5cfc-4166-a973-dacb9af656d3 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1731 microversion: 2.20 time: 0.159441 Aug 31 00:26:38.442285 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 484/967] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:38 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:26:39.176257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:39.176901 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:39.183376 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:39.183858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:39.184322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:39.184996 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:39.185454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:39.185916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:39.315488 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:39.323224 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1255fe2b-0d88-4eb9-b9f1-6a5c404b6f10 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1674 microversion: 2.1 time: 0.150898 Aug 31 00:26:39.323789 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 484/968] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:39 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:39.464764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:39.465289 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:39.472194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:39.472670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:39.473102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:39.473779 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:39.474255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:39.474676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:39.601519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:39.610161 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:39.611614 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:39.612775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a016f82e-43fc-45fb-93a0-807626a74668 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1718 microversion: 2.20 time: 0.152060 Aug 31 00:26:39.613333 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 485/969] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:26:39 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:26:40.345286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:40.345916 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:40.352272 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:40.352748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:40.353177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:40.353906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:40.354352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:40.354770 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:40.481565 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:40.490173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-2fc2d0aa-fa42-473a-a70c-09639387bf38 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1674 microversion: 2.1 time: 0.148713 Aug 31 00:26:40.490758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 485/970] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:40 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:41.512643 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:41.513280 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:41.519967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.520458 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.520900 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.521601 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:41.522092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:41.522529 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:41.734601 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:41.742519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9bb6edc0-fef0-4fa7-a2e4-aa291c2ac0a5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1674 microversion: 2.1 time: 0.234114 Aug 31 00:26:41.743097 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 486/971] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:41 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1674 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:42.323492 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-1588ecd1-bb24-402e-ac09-8475760ad29f req-0d2eb3d0-0e12-47fa-9e80-f0a65ca0586c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a68b76-10b6-44b6-b459-9b5c469bb0b7", "name": "network-vif-deleted", "tag": "e1fe3d3b-41e3-4469-99f8-484a2d4d0840"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:42.336408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-1588ecd1-bb24-402e-ac09-8475760ad29f req-0d2eb3d0-0e12-47fa-9e80-f0a65ca0586c service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:42.336886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-1588ecd1-bb24-402e-ac09-8475760ad29f req-0d2eb3d0-0e12-47fa-9e80-f0a65ca0586c service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:42.337313 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-1588ecd1-bb24-402e-ac09-8475760ad29f req-0d2eb3d0-0e12-47fa-9e80-f0a65ca0586c service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:42.349917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-1588ecd1-bb24-402e-ac09-8475760ad29f req-0d2eb3d0-0e12-47fa-9e80-f0a65ca0586c service nova] Creating event network-vif-deleted:e1fe3d3b-41e3-4469-99f8-484a2d4d0840 for instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 on hv-cinder-85220 Aug 31 00:26:42.354909 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-1588ecd1-bb24-402e-ac09-8475760ad29f req-0d2eb3d0-0e12-47fa-9e80-f0a65ca0586c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035290 Aug 31 00:26:42.356028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 486/972] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:42.764768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:42.765410 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:42.771985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:42.772415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:42.772864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:42.773564 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:42.774059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:42.774495 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:42.808095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:42.808582 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:42.809021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:42.809466 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lazy-loading 'fault' on Instance uuid 75a68b76-10b6-44b6-b459-9b5c469bb0b7 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:26:42.853354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f519b1d9a1149169b8142e738320a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc2aed79de4b3d92d19ef9bf26cc51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:42.862391 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c53216fe-49da-416e-979f-fc9624f4f4fe tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 200 len: 1327 microversion: 2.1 time: 0.102003 Aug 31 00:26:42.863066 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 487/973] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:42 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:26:43.883973 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:43.884677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:43.891526 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:43.892014 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:43.892453 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:43.893145 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:43.893605 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:43.894066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:43.907643 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] HTTP exception thrown: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Request method failure captured: Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 HTTP/1.1 Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj7xedGa9z-OTusjjyI_2eE_-0vOag6oMYMvJvodxgITzUDIJDaNXRm1TsLM2aHzzgGGm99gKbGX7sfNpM7a5jjdVKaO-zQh94BuWhQJXCBUhUr9T9aNvfOiC1ZVjp_-CfVi2b681nlB93UaLSs9pk8P331cNXQUBbeHQgM2EkrfEs Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:26:43.909234 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 3f519b1d9a1149169b8142e738320a89 Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:43.914954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '75a68b76-10b6-44b6-b459-9b5c469bb0b7'} Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:43.916156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:43.917724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:43.919183 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Returning 404 to user: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:43.919183 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-95436508-72f4-4f32-b189-65f340ba6337 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 404 len: 111 microversion: 2.1 time: 0.030971 Aug 31 00:26:43.919183 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 487/974] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:43 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:43.919584 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a8a75645-0931-4163-9d7e-da986160f7ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '.version_select at 0x7fcd6bc69e50>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:43.939166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a8a75645-0931-4163-9d7e-da986160f7ec tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499228745" status: 202 len: 0 microversion: 2.1 time: 0.023556 Aug 31 00:26:43.939716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 488/975] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 31 00:26:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499228745 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:26:46.799444 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:46.799927 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:46.805984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:46.806553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:46.806986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:46.807669 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:46.808121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:46.808545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:46.822255 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] HTTP exception thrown: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Request method failure captured: Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: DELETE /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 HTTP/1.1 Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj7xedGa9z-OTusjjyI_2eE_-0vOag6oMYMvJvodxgITzUDIJDaNXRm1TsLM2aHzzgGGm99gKbGX7sfNpM7a5jjdVKaO-zQh94BuWhQJXCBUhUr9T9aNvfOiC1ZVjp_-CfVi2b681nlB93UaLSs9pk8P331cNXQUBbeHQgM2EkrfEs Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:26:46.823768 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 3f519b1d9a1149169b8142e738320a89 Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.825354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '75a68b76-10b6-44b6-b459-9b5c469bb0b7'} Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:46.827041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.828580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.830204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Returning 404 to user: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:46.830204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-456259db-a215-42ce-a51c-5e053d971df5 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 404 len: 111 microversion: 2.1 time: 0.030370 Aug 31 00:26:46.830204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 488/976] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:26:46 2022] DELETE /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:46.834753 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:46.835400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: 75a68b76-10b6-44b6-b459-9b5c469bb0b7] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:46.842135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:46.842621 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:46.843062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:46.843751 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:46.844209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:46.844638 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:46.858153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] HTTP exception thrown: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Request method failure captured: Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 HTTP/1.1 Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqj7xedGa9z-OTusjjyI_2eE_-0vOag6oMYMvJvodxgITzUDIJDaNXRm1TsLM2aHzzgGGm99gKbGX7sfNpM7a5jjdVKaO-zQh94BuWhQJXCBUhUr9T9aNvfOiC1ZVjp_-CfVi2b681nlB93UaLSs9pk8P331cNXQUBbeHQgM2EkrfEs Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:26:46.859797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 3f519b1d9a1149169b8142e738320a89 Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.861138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '75a68b76-10b6-44b6-b459-9b5c469bb0b7'} Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:46.861952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. Aug 31 00:26:46.863249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:46.864393 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Returning 404 to user: Instance 75a68b76-10b6-44b6-b459-9b5c469bb0b7 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:46.864393 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d2995ece-ec3b-4985-bb78-5b96258ffcb9 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7" status: 404 len: 111 microversion: 2.1 time: 0.030361 Aug 31 00:26:46.864393 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 489/977] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:46 2022] GET /compute/v2.1/servers/75a68b76-10b6-44b6-b459-9b5c469bb0b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:47.995886 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:47.996388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:48.003486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:48.003968 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:48.004405 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:48.005096 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:48.005549 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:48.006020 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:48.019330 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] HTTP exception thrown: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Request method failure captured: Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: DELETE /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a HTTP/1.1 Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj7xedGa9z-OTusjjyI_2eE_-0vOag6oMYMvJvodxgITzUDIJDaNXRm1TsLM2aHzzgGGm99gKbGX7sfNpM7a5jjdVKaO-zQh94BuWhQJXCBUhUr9T9aNvfOiC1ZVjp_-CfVi2b681nlB93UaLSs9pk8P331cNXQUBbeHQgM2EkrfEs Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:26:48.020872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 3f519b1d9a1149169b8142e738320a89 Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.022505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': 'acd82cf1-9e95-469a-ae36-ffca42f83f3a'} Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:48.023505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.024994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.026655 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Returning 404 to user: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:48.026655 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7f8b494a-efc3-470e-9d4a-f7a55afb0122 tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "DELETE /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 404 len: 111 microversion: 2.1 time: 0.030164 Aug 31 00:26:48.026655 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 489/978] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:26:47 2022] DELETE /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:48.030627 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:48.031233 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] [instance: acd82cf1-9e95-469a-ae36-ffca42f83f3a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:48.037965 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:48.038446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:48.038882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:48.039582 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:48.040032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:48.040453 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:48.054803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] HTTP exception thrown: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Request method failure captured: Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a HTTP/1.1 Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqj7xedGa9z-OTusjjyI_2eE_-0vOag6oMYMvJvodxgITzUDIJDaNXRm1TsLM2aHzzgGGm99gKbGX7sfNpM7a5jjdVKaO-zQh94BuWhQJXCBUhUr9T9aNvfOiC1ZVjp_-CfVi2b681nlB93UaLSs9pk8P331cNXQUBbeHQgM2EkrfEs Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:26:48.056323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74bc2aed79de4b3d92d19ef9bf26cc51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 74bc2aed79de4b3d92d19ef9bf26cc51 Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeTestJSON-734911503 Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 3f519b1d9a1149169b8142e738320a89 Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeTestJSON-734911503-project Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.057935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': 'acd82cf1-9e95-469a-ae36-ffca42f83f3a'} Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:26:48.059077 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. Aug 31 00:26:48.061194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:26:48.062871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] Returning 404 to user: Instance acd82cf1-9e95-469a-ae36-ffca42f83f3a could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:26:48.062871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7632a12f-fa64-4ee0-a1b7-15960a3b64ab tempest-AttachVolumeTestJSON-734911503 tempest-AttachVolumeTestJSON-734911503-project] 10.222.0.49 "GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a" status: 404 len: 111 microversion: 2.1 time: 0.030888 Aug 31 00:26:48.062871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 490/979] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:48 2022] GET /compute/v2.1/servers/acd82cf1-9e95-469a-ae36-ffca42f83f3a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:48.112548 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8dd04925-cd15-448f-8013-151a19f12381 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:48.113045 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8dd04925-cd15-448f-8013-151a19f12381 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:48.119589 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8dd04925-cd15-448f-8013-151a19f12381 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:48.120009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8dd04925-cd15-448f-8013-151a19f12381 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:48.120461 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8dd04925-cd15-448f-8013-151a19f12381 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:48.121150 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8dd04925-cd15-448f-8013-151a19f12381 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:48.121592 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8dd04925-cd15-448f-8013-151a19f12381 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:48.122057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8dd04925-cd15-448f-8013-151a19f12381 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:48.146487 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8dd04925-cd15-448f-8013-151a19f12381 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/ips" status: 200 len: 148 microversion: 2.1 time: 0.037622 Aug 31 00:26:48.153464 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 490/980] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:26:48 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:49.516173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-60d1f443-7da6-4d11-865d-8f7c545ee77c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e3c450b-33b0-4fce-ab32-1924a586deb8"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:49.518574 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-60d1f443-7da6-4d11-865d-8f7c545ee77c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:49.524880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-60d1f443-7da6-4d11-865d-8f7c545ee77c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.525363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-60d1f443-7da6-4d11-865d-8f7c545ee77c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.525802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-60d1f443-7da6-4d11-865d-8f7c545ee77c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:49.526522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-60d1f443-7da6-4d11-865d-8f7c545ee77c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:49.526975 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-60d1f443-7da6-4d11-865d-8f7c545ee77c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:49.527401 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-60d1f443-7da6-4d11-865d-8f7c545ee77c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:49.828442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-60d1f443-7da6-4d11-865d-8f7c545ee77c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316487 Aug 31 00:26:49.834235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 491/981] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:26:49 2022] POST /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:57.383559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fa719b26-788a-4067-94dd-4b7f4491d7dd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: .version_select at 0x7fcd701bfa60>, body: {"keypair": {"name": "tempest-keypair-231822356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSB/eU4l2yi8h74+BmLQbQF21aqvsNP3fo1shHZdEnf850bls/4jtxb0cMDoKhA9ly5IIJ0UhsETBpQ5862wWPjnxjDXoxvHOraLNuaC1n7ikC4ZiFXqVrDIV71GFjAkQ=="}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:57.399844 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-fa719b26-788a-4067-94dd-4b7f4491d7dd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:26:57.403583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-fa719b26-788a-4067-94dd-4b7f4491d7dd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for user 988168279e8e495a985e209a35764f2b and project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:26:57.426283 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fa719b26-788a-4067-94dd-4b7f4491d7dd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046540 Aug 31 00:26:57.426875 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 491/982] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:26:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:26:58.724879 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-62041952", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c68b95b5-2004-4926-97ca-43c398029473"}], "security_groups": [{"name": "tempest-securitygroup--1749817671"}], "key_name": "tempest-keypair-231822356", "user_data": "}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:26:58.846757 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] validate_networks() for [('c68b95b5-2004-4926-97ca-43c398029473', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:26:59.227824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:26:59.228882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:26:59.229396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:26:59.229813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:26:59.230332 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:26:59.239900 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:59.240381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:59.240819 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:59.241557 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:26:59.242049 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:26:59.242476 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:26:59.259504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:26:59.264224 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for user 988168279e8e495a985e209a35764f2b and project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:26:59.275437 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:26:59.277868 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:26:59.325626 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ab3f7dc5-6923-46d4-8f2d-3e6c1e919e8f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606009 Aug 31 00:26:59.326228 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 492/983] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:26:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:26:59.338179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ce99e1a4-446c-4285-8f7e-74c8edd5fad6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:26:59.338934 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ce99e1a4-446c-4285-8f7e-74c8edd5fad6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:26:59.341999 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=58 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:59.397034 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ce99e1a4-446c-4285-8f7e-74c8edd5fad6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:26:59.405341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ce99e1a4-446c-4285-8f7e-74c8edd5fad6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1239 microversion: 2.1 time: 0.072051 Aug 31 00:26:59.406458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 492/984] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:26:59 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:00.427113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:00.427731 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:00.434135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.434617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.435120 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.435810 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:00.436266 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:00.436726 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:00.500691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:00.509418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9a0602f4-c11c-4e68-8dea-142354b2b674 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1291 microversion: 2.1 time: 0.086684 Aug 31 00:27:00.510004 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 493/985] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:00 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1291 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:01.530553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:01.531239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:01.534054 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:01.540928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.541418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.541874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.542613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:01.543062 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:01.543483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:01.699012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:01.707450 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-05d5195e-4c67-4928-ae53-ccf1a7e980e7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1365 microversion: 2.1 time: 0.181378 Aug 31 00:27:01.708032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 493/986] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:01 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:02.398395 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-26791ed3-ead1-4ff6-b737-496119f1b4db req-b2ca35da-6e5f-4ca5-9b3d-49b5665a8098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b297fa7f-eb55-4948-b66c-8f36ed32041f", "tag": "526ca82e-243c-426f-87eb-be7052ec8bba"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:02.409742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:02.411860 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-26791ed3-ead1-4ff6-b737-496119f1b4db req-b2ca35da-6e5f-4ca5-9b3d-49b5665a8098 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:02.412796 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-26791ed3-ead1-4ff6-b737-496119f1b4db req-b2ca35da-6e5f-4ca5-9b3d-49b5665a8098 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:02.413197 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-26791ed3-ead1-4ff6-b737-496119f1b4db req-b2ca35da-6e5f-4ca5-9b3d-49b5665a8098 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:02.428032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-26791ed3-ead1-4ff6-b737-496119f1b4db req-b2ca35da-6e5f-4ca5-9b3d-49b5665a8098 service nova] Creating event network-changed:526ca82e-243c-426f-87eb-be7052ec8bba for instance b297fa7f-eb55-4948-b66c-8f36ed32041f on hv-cinder-85220 Aug 31 00:27:02.433293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-26791ed3-ead1-4ff6-b737-496119f1b4db req-b2ca35da-6e5f-4ca5-9b3d-49b5665a8098 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039202 Aug 31 00:27:02.433936 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 494/987] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:27:02.728351 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:02.728972 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:02.736085 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:02.736695 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:02.737141 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:02.737867 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:02.738317 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:02.738743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:02.909907 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:02.918240 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-98ab8022-ad5e-4b35-af2d-bae21cae7770 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1365 microversion: 2.1 time: 0.193613 Aug 31 00:27:02.919829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 494/988] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:02 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:03.941287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:03.942032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:03.948677 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:03.949161 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:03.949599 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:03.950866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:03.951327 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:03.951753 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:04.082064 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:04.089681 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-117d401e-2ac8-4b9c-b0d4-c386c13ec40e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1365 microversion: 2.1 time: 0.153779 Aug 31 00:27:04.090281 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 495/989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:03 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:05.111560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:05.112099 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:05.118443 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:05.118919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:05.119341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:05.120023 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:05.120467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:05.120880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:05.246910 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:05.254560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fd744a5d-01c9-448d-9651-1421298138d7 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1365 microversion: 2.1 time: 0.146959 Aug 31 00:27:05.255123 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 495/990] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:05 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:06.275854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:06.276424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:06.284523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:06.285016 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:06.285463 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:06.287074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:06.287551 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:06.287989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:06.291049 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:06.429626 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:06.437445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-965e61d0-e180-45aa-87d1-5a3cc98fe599 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1365 microversion: 2.1 time: 0.165583 Aug 31 00:27:06.438033 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 496/991] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:06 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:07.458479 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:07.459081 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:07.465564 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:07.466165 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:07.466693 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:07.467329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:07.467859 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:07.468303 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:07.592930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-c3cdf812-e405-4c91-9cbb-8508a5897c8a req-b62ad193-a960-4e5f-aab7-113adc1f11ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b297fa7f-eb55-4948-b66c-8f36ed32041f", "name": "network-vif-plugged", "status": "completed", "tag": "526ca82e-243c-426f-87eb-be7052ec8bba"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:07.619004 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-c3cdf812-e405-4c91-9cbb-8508a5897c8a req-b62ad193-a960-4e5f-aab7-113adc1f11ea service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:07.619317 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-c3cdf812-e405-4c91-9cbb-8508a5897c8a req-b62ad193-a960-4e5f-aab7-113adc1f11ea service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:07.619746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-c3cdf812-e405-4c91-9cbb-8508a5897c8a req-b62ad193-a960-4e5f-aab7-113adc1f11ea service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:07.621794 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:07.632738 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4cbfa5c5-4085-43ee-bb17-1b0bee32537e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1365 microversion: 2.1 time: 0.178428 Aug 31 00:27:07.635276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-c3cdf812-e405-4c91-9cbb-8508a5897c8a req-b62ad193-a960-4e5f-aab7-113adc1f11ea service nova] Creating event network-vif-plugged:526ca82e-243c-426f-87eb-be7052ec8bba for instance b297fa7f-eb55-4948-b66c-8f36ed32041f on hv-cinder-85220 Aug 31 00:27:07.645235 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 496/992] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:07 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:07.648564 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-c3cdf812-e405-4c91-9cbb-8508a5897c8a req-b62ad193-a960-4e5f-aab7-113adc1f11ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065548 Aug 31 00:27:07.650079 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 497/993] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:08.655418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:08.656041 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:08.662743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:08.663227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:08.663664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:08.664355 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:08.664813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:08.665238 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:08.801555 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:08.810214 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-70e655a8-5275-42d0-ba03-b6c91b5961c8 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1365 microversion: 2.1 time: 0.158624 Aug 31 00:27:08.810956 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 497/994] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:08 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:09.828844 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:09.829619 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=6 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:09.834105 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:09.834808 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:09.841799 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:09.842306 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:09.842741 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:09.843422 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:09.843891 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:09.844293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:09.970935 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:09.978518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-08539052-96ff-4ec0-b19a-6014cadf5942 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1365 microversion: 2.1 time: 0.151136 Aug 31 00:27:09.979073 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 498/995] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:09 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:10.999556 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:11.000903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:11.002986 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=6 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:11.009237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:11.009735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:11.010192 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:11.010887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:11.011335 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:11.011767 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:11.154245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:11.161976 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5d622d2a-24d6-4dee-ba3a-e64aab4c9603 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1554 microversion: 2.1 time: 0.166789 Aug 31 00:27:11.162541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 498/996] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:10 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:11.184012 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7033ccfe-a6b0-4a2f-a4d2-fcfd22787860 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:11.185161 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7033ccfe-a6b0-4a2f-a4d2-fcfd22787860 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:11.193034 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7033ccfe-a6b0-4a2f-a4d2-fcfd22787860 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:11.193519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7033ccfe-a6b0-4a2f-a4d2-fcfd22787860 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:11.194019 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7033ccfe-a6b0-4a2f-a4d2-fcfd22787860 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:11.194719 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7033ccfe-a6b0-4a2f-a4d2-fcfd22787860 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:11.195204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7033ccfe-a6b0-4a2f-a4d2-fcfd22787860 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:11.195634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7033ccfe-a6b0-4a2f-a4d2-fcfd22787860 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:11.269629 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7033ccfe-a6b0-4a2f-a4d2-fcfd22787860 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090296 Aug 31 00:27:11.270249 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 499/997] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 31 00:27:11 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:12.539949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-fa7114da-261a-4496-8464-361372117549 req-c4f51de4-3a84-490a-963f-5524465f6c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b297fa7f-eb55-4948-b66c-8f36ed32041f", "tag": "526ca82e-243c-426f-87eb-be7052ec8bba"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:12.550865 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-fa7114da-261a-4496-8464-361372117549 req-c4f51de4-3a84-490a-963f-5524465f6c0a service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:12.551456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-fa7114da-261a-4496-8464-361372117549 req-c4f51de4-3a84-490a-963f-5524465f6c0a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:12.551956 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-fa7114da-261a-4496-8464-361372117549 req-c4f51de4-3a84-490a-963f-5524465f6c0a service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:12.563523 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-fa7114da-261a-4496-8464-361372117549 req-c4f51de4-3a84-490a-963f-5524465f6c0a service nova] Creating event network-changed:526ca82e-243c-426f-87eb-be7052ec8bba for instance b297fa7f-eb55-4948-b66c-8f36ed32041f on hv-cinder-85220 Aug 31 00:27:12.568890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-fa7114da-261a-4496-8464-361372117549 req-c4f51de4-3a84-490a-963f-5524465f6c0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032638 Aug 31 00:27:12.569972 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 499/998] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:27.961037 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=11 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:27.961999 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=17 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:27.965835 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d933bac3-0ddc-479d-bcb7-95c0b00c4be7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:27.968191 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d933bac3-0ddc-479d-bcb7-95c0b00c4be7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:27.974937 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d933bac3-0ddc-479d-bcb7-95c0b00c4be7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:27.975424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d933bac3-0ddc-479d-bcb7-95c0b00c4be7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:27.975866 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d933bac3-0ddc-479d-bcb7-95c0b00c4be7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:27.976588 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d933bac3-0ddc-479d-bcb7-95c0b00c4be7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:27.977045 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d933bac3-0ddc-479d-bcb7-95c0b00c4be7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:27.977477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d933bac3-0ddc-479d-bcb7-95c0b00c4be7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:28.006553 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d933bac3-0ddc-479d-bcb7-95c0b00c4be7 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046795 Aug 31 00:27:28.007174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 500/999] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 31 00:27:27 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:28.070963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:28.071820 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:28.074796 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=13 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:28.075441 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=38 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:28.081724 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:28.082261 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:28.082701 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:28.083410 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:28.083868 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:28.084297 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:28.110277 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:27:28.193177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9d156424-7a50-4883-9a15-de5fd5d23936 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 204 len: 0 microversion: 2.20 time: 0.126089 Aug 31 00:27:28.193878 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 500/1000] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 31 00:27:28 2022] DELETE /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:27:28.203346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:28.204364 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:28.210768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:28.211247 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:28.211678 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:28.212360 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:28.212807 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:28.213226 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:28.349052 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:28.357611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:28.359108 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:28.360262 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ed0c0629-e188-4ab5-aa65-dbd492987085 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.161555 Aug 31 00:27:28.360818 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 501/1001] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:28 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:29.384410 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:29.385188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:29.391664 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:29.392144 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:29.392575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:29.393255 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:29.393703 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:29.394154 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:29.522459 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:29.531206 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:29.532689 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:29.533868 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0e49d4b1-4f5d-46af-836b-1bd5c62e908e tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.153770 Aug 31 00:27:29.534433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 501/1002] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:29 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:30.557682 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:30.558305 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:30.565013 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:30.565497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:30.565961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:30.566654 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:30.567110 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:30.567560 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:30.696000 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:30.704558 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:30.706042 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:30.707278 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-fb4481b8-73b3-444b-8141-1dcec3582495 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.153548 Aug 31 00:27:30.707840 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 502/1003] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:30 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:31.730175 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:31.731267 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:31.737639 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:31.738145 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:31.738579 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:31.739259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:31.739703 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:31.740122 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:31.871590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:31.879747 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:31.881157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:31.882339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5b96f012-dcc1-4479-94cb-90b07c9dce18 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1724 microversion: 2.20 time: 0.156260 Aug 31 00:27:31.882902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 502/1004] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:31 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:32.906573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:32.907966 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:32.915298 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:32.915820 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:32.916258 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:32.916956 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:32.917921 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:32.918354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:33.271117 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:33.279381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:33.280851 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:33.282751 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cd4ab63e-300a-4a73-a29c-1466025cc72a tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1656 microversion: 2.20 time: 0.380260 Aug 31 00:27:33.283547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 503/1005] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:32 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1656 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:27:33.342368 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-3cd183cc-d40b-4de0-b856-21bed8ad8bff req-b2c737cc-fe78-49fc-b724-5a900fb0d860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd646c5-f435-4d57-acb3-1ceb01a56868", "name": "network-vif-deleted", "tag": "3f18d97a-669b-4781-8b9e-7428a4c4fbda"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:33.352479 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3cd183cc-d40b-4de0-b856-21bed8ad8bff req-b2c737cc-fe78-49fc-b724-5a900fb0d860 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:33.352889 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3cd183cc-d40b-4de0-b856-21bed8ad8bff req-b2c737cc-fe78-49fc-b724-5a900fb0d860 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:33.353322 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-3cd183cc-d40b-4de0-b856-21bed8ad8bff req-b2c737cc-fe78-49fc-b724-5a900fb0d860 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:33.364627 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-3cd183cc-d40b-4de0-b856-21bed8ad8bff req-b2c737cc-fe78-49fc-b724-5a900fb0d860 service nova] Creating event network-vif-deleted:3f18d97a-669b-4781-8b9e-7428a4c4fbda for instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 on hv-cinder-85220 Aug 31 00:27:33.369411 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-3cd183cc-d40b-4de0-b856-21bed8ad8bff req-b2c737cc-fe78-49fc-b724-5a900fb0d860 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Aug 31 00:27:33.370028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 503/1006] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:34.306496 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:34.307135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:34.314329 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:34.314888 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:34.315240 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:34.315947 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:34.316407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:34.316837 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:34.379775 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:34.387924 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:34.389318 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:34.390518 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8908179d-84f1-4dd9-bd5d-f68fd8cdfbeb tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1656 microversion: 2.20 time: 0.088275 Aug 31 00:27:34.391078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 504/1007] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:34 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1656 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:27:35.413602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:35.414330 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:35.420820 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:35.421300 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:35.421749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:35.422480 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:35.422932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:35.423358 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:35.487866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:35.497798 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:35.499287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:35.500423 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e0b3f4a2-1527-4693-a48c-6302ee868fd1 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1366 microversion: 2.20 time: 0.091519 Aug 31 00:27:35.500972 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 504/1008] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:35 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:36.524898 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:36.525513 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:36.532823 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:36.533312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:36.534153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:36.534855 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:36.535314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:36.535747 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:36.569523 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:36.570059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:36.570497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:36.570945 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lazy-loading 'fault' on Instance uuid 3fd646c5-f435-4d57-acb3-1ceb01a56868 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:27:36.612629 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:36.621358 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:36.622930 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:36.624105 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ddd68957-9b5d-43d4-85c1-4dfd8a9fbe42 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1371 microversion: 2.20 time: 0.103127 Aug 31 00:27:36.624663 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 505/1009] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:36 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:37.647727 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:37.648334 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:37.655337 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.655820 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.656262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.656949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.657398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.657825 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.688884 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:37.689363 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:37.689797 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:37.690264 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lazy-loading 'fault' on Instance uuid 3fd646c5-f435-4d57-acb3-1ceb01a56868 {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:27:37.729310 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:37.738040 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:37.739482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:37.740629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-12e6e9db-1157-4b60-afe1-18b2618d10ee tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1371 microversion: 2.20 time: 0.096830 Aug 31 00:27:37.741183 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 505/1010] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:37 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:38.763104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:38.763692 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:38.769865 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:38.770345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:38.770773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:38.771447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:38.771892 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:38.772309 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:38.802236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:38.802700 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:38.803135 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:38.803570 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lazy-loading 'fault' on Instance uuid 3fd646c5-f435-4d57-acb3-1ceb01a56868 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:27:38.842967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:38.850853 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:38.852293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a76438b57a2140cca853e0e71fb28f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:38.853427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-89706c0e-e55e-4d04-89f9-f0de41928d2c tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 200 len: 1371 microversion: 2.20 time: 0.094577 Aug 31 00:27:38.854000 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 506/1011] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:38 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:39.876223 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:39.876826 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:39.883513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.883985 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.884413 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.885100 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:39.885545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:39.886671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:39.903679 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] HTTP exception thrown: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Request method failure captured: Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 HTTP/1.1 Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj4-HDPR070jRUYhtloLA-yUS-IDnMrcsHzSq26iBS-LjGa_SYH_Dfeg_wIFAG6OcD_ISxXkeoDX136VrN6SnFc0p5OvfuoSBhgxqnrnXNyHrbCVbwVUuZRR_yuIb0j5WR5qRcELG4CH7zGYsALd6l4SdQmHaCvC9KTqNVrOxTzQMk Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:27:39.905525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: a76438b57a2140cca853e0e71fb28f64 Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:39.907118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '3fd646c5-f435-4d57-acb3-1ceb01a56868'} Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:39.907964 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:39.909594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:39.911903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Returning 404 to user: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:39.911903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-be824962-aad2-4b12-9753-bcf6e61bcc26 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 404 len: 111 microversion: 2.20 time: 0.034630 Aug 31 00:27:39.911903 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 506/1012] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:39 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:27:39.917370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0ed76e11-a997-4895-9c1a-0763180471c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '.version_select at 0x7fcd6bfdd940>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:39.937202 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0ed76e11-a997-4895-9c1a-0763180471c0 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925333364" status: 204 len: 0 microversion: 2.20 time: 0.023975 Aug 31 00:27:39.937968 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 507/1013] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 31 00:27:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925333364 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:27:41.678190 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:41.678697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:41.685200 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:41.685682 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:41.686139 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:41.686831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:41.687286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:41.687767 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:41.702835 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] HTTP exception thrown: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Request method failure captured: Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: DELETE /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 HTTP/1.1 Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj4-HDPR070jRUYhtloLA-yUS-IDnMrcsHzSq26iBS-LjGa_SYH_Dfeg_wIFAG6OcD_ISxXkeoDX136VrN6SnFc0p5OvfuoSBhgxqnrnXNyHrbCVbwVUuZRR_yuIb0j5WR5qRcELG4CH7zGYsALd6l4SdQmHaCvC9KTqNVrOxTzQMk Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:27:41.704538 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: a76438b57a2140cca853e0e71fb28f64 Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.706362 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '3fd646c5-f435-4d57-acb3-1ceb01a56868'} Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:41.707575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.709188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.711556 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Returning 404 to user: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:41.711556 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-256dfbd2-8972-4a12-bf03-5a7bd4a1d1de tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 404 len: 111 microversion: 2.20 time: 0.031547 Aug 31 00:27:41.711556 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 507/1014] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 31 00:27:41 2022] DELETE /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:27:41.716852 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:41.717466 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 3fd646c5-f435-4d57-acb3-1ceb01a56868] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:41.725170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:41.725654 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:41.726115 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:41.726811 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:41.727263 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:41.727749 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:41.741469 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] HTTP exception thrown: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Request method failure captured: Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 HTTP/1.1 Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqj4-HDPR070jRUYhtloLA-yUS-IDnMrcsHzSq26iBS-LjGa_SYH_Dfeg_wIFAG6OcD_ISxXkeoDX136VrN6SnFc0p5OvfuoSBhgxqnrnXNyHrbCVbwVUuZRR_yuIb0j5WR5qRcELG4CH7zGYsALd6l4SdQmHaCvC9KTqNVrOxTzQMk Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:27:41.743150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: a76438b57a2140cca853e0e71fb28f64 Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.744909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '3fd646c5-f435-4d57-acb3-1ceb01a56868'} Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:41.746390 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. Aug 31 00:27:41.747933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:41.749401 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Returning 404 to user: Instance 3fd646c5-f435-4d57-acb3-1ceb01a56868 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:41.749401 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-533644de-f54b-4ce1-8022-148380217177 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868" status: 404 len: 111 microversion: 2.20 time: 0.033952 Aug 31 00:27:41.749401 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 508/1015] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:41 2022] GET /compute/v2.1/servers/3fd646c5-f435-4d57-acb3-1ceb01a56868 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:27:42.879264 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:42.879793 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:42.886122 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:42.886626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:42.887056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:42.887730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:42.888175 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:42.888593 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:42.904450 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] HTTP exception thrown: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Request method failure captured: Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: DELETE /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a HTTP/1.1 Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqj4-HDPR070jRUYhtloLA-yUS-IDnMrcsHzSq26iBS-LjGa_SYH_Dfeg_wIFAG6OcD_ISxXkeoDX136VrN6SnFc0p5OvfuoSBhgxqnrnXNyHrbCVbwVUuZRR_yuIb0j5WR5qRcELG4CH7zGYsALd6l4SdQmHaCvC9KTqNVrOxTzQMk Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:27:42.906012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: a76438b57a2140cca853e0e71fb28f64 Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.907866 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '28862807-4ab6-4376-9e01-b40cd4e4483a'} Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:42.908784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.910329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.912075 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Returning 404 to user: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:42.912075 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-18d1da24-45f0-43d2-b5f9-10ee30b3ea14 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 404 len: 111 microversion: 2.20 time: 0.032035 Aug 31 00:27:42.912075 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 508/1016] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 31 00:27:42 2022] DELETE /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:27:42.916510 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:42.917805 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] [instance: 28862807-4ab6-4376-9e01-b40cd4e4483a] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:42.924345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:42.924834 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:42.925276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:42.926006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:42.926489 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:42.926929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:42.940284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] HTTP exception thrown: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Request method failure captured: Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a HTTP/1.1 Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqj4-HDPR070jRUYhtloLA-yUS-IDnMrcsHzSq26iBS-LjGa_SYH_Dfeg_wIFAG6OcD_ISxXkeoDX136VrN6SnFc0p5OvfuoSBhgxqnrnXNyHrbCVbwVUuZRR_yuIb0j5WR5qRcELG4CH7zGYsALd6l4SdQmHaCvC9KTqNVrOxTzQMk Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:27:42.941880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eed416bd0f5f4e2e8453db6ff35f6ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: eed416bd0f5f4e2e8453db6ff35f6ac5 Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-879406857 Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: a76438b57a2140cca853e0e71fb28f64 Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeShelveTestJSON-879406857-project Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.943624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '28862807-4ab6-4376-9e01-b40cd4e4483a'} Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:42.944436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. Aug 31 00:27:42.945674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:42.946941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] Returning 404 to user: Instance 28862807-4ab6-4376-9e01-b40cd4e4483a could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:42.946941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2a9c4c60-960b-4702-a6ae-71c8c1648758 tempest-AttachVolumeShelveTestJSON-879406857 tempest-AttachVolumeShelveTestJSON-879406857-project] 10.222.0.49 "GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a" status: 404 len: 111 microversion: 2.20 time: 0.030903 Aug 31 00:27:42.946941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 509/1017] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 31 00:27:42 2022] GET /compute/v2.1/servers/28862807-4ab6-4376-9e01-b40cd4e4483a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:27:47.260919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c394980d-c78a-4707-8032-f7924390599e tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Action: 'create', calling method: .version_select at 0x7fcd6bd8da60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-337626212"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:47.567999 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c394980d-c78a-4707-8032-f7924390599e tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.568879 Aug 31 00:27:47.569375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 509/1018] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Aug 31 00:27:46 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 571 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 00:27:47.581651 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-13c1d49b-3aaf-465e-af72-b9a3e7bf8aa0 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bfdd160>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:47.636234 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-13c1d49b-3aaf-465e-af72-b9a3e7bf8aa0 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644" status: 200 len: 344 microversion: 2.1 time: 0.058312 Aug 31 00:27:47.636802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 510/1019] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:27:47 2022] GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:48.650842 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a8de55c4-977c-483a-ba6c-23865f41749a tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bc429d0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:48.697984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a8de55c4-977c-483a-ba6c-23865f41749a tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644" status: 200 len: 345 microversion: 2.1 time: 0.051577 Aug 31 00:27:48.698545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 510/1020] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:27:48 2022] GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:48.711252 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e0dbcf15-ca6c-49c1-87c5-4985e7d64166 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Action: 'create', calling method: .version_select at 0x7fcd701ea550>, body: {"snapshot": {"volume_id": "8744ce5c-dd55-4b7e-9c99-a29ab6a33644", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-613991765"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:48.872075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e0dbcf15-ca6c-49c1-87c5-4985e7d64166 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.165039 Aug 31 00:27:48.872664 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 511/1021] 10.222.0.49 () {60 vars in 1162 bytes} [Wed Aug 31 00:27:48 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:48.883245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9b39ce38-58c4-4410-bf6c-529af00382a3 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bbfd430>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:48.914882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9b39ce38-58c4-4410-bf6c-529af00382a3 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 200 len: 286 microversion: 2.1 time: 0.035087 Aug 31 00:27:48.915637 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 511/1022] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:48 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:48.926493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9eac6783-c64f-4d2e-9033-1a10c3297728 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bd0de50>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:48.957389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9eac6783-c64f-4d2e-9033-1a10c3297728 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034695 Aug 31 00:27:48.957978 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 512/1023] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 31 00:27:48 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:27:48.968887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f421468c-0587-45fd-a063-e1ead956e636 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bc42ee0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:48.998172 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f421468c-0587-45fd-a063-e1ead956e636 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 200 len: 286 microversion: 2.1 time: 0.033029 Aug 31 00:27:48.998716 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 512/1024] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:48 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:50.011770 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8df78ad6-87e2-4dd1-8f6f-2d081c43fd47 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bc8eee0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:50.043777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8df78ad6-87e2-4dd1-8f6f-2d081c43fd47 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 200 len: 286 microversion: 2.1 time: 0.036915 Aug 31 00:27:50.044333 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 513/1025] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:50 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:51.056902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0d85f5b3-6c68-4f5f-907e-474fedfe899e tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bfa7790>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:51.085827 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0d85f5b3-6c68-4f5f-907e-474fedfe899e tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 200 len: 286 microversion: 2.1 time: 0.033306 Aug 31 00:27:51.086416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 513/1026] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:51 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:52.099657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-872520f5-3aa3-4d59-9346-d640c9ed929a tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bfd2d30>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:52.136170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-872520f5-3aa3-4d59-9346-d640c9ed929a tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 200 len: 287 microversion: 2.1 time: 0.040192 Aug 31 00:27:52.136785 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 514/1027] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:52 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:52.148563 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e5cd0704-8f0f-4718-8d88-b8a78f537d60 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bdb7ca0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:52.205286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e5cd0704-8f0f-4718-8d88-b8a78f537d60 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 202 len: 0 microversion: 2.1 time: 0.061297 Aug 31 00:27:52.205896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 514/1028] 10.222.0.49 () {58 vars in 1254 bytes} [Wed Aug 31 00:27:52 2022] DELETE /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:27:52.214189 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1a22caf2-2794-49ec-82ae-8efe956acd44 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bcd04c0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:52.243510 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1a22caf2-2794-49ec-82ae-8efe956acd44 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 200 len: 286 microversion: 2.1 time: 0.033274 Aug 31 00:27:52.244074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 515/1029] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:52 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:53.253399 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:53.254190 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:53.258532 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-24b27016-c547-4b04-8cf7-8139f0bc7672 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd7363dca0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:53.287935 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-24b27016-c547-4b04-8cf7-8139f0bc7672 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 200 len: 286 microversion: 2.1 time: 0.035297 Aug 31 00:27:53.288494 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 515/1030] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:53 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:53.378553 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:53.379303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=50 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:53.383909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:53.384436 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:53.392549 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:53.393025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:53.393459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:53.394162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:53.394611 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:53.395030 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:53.418041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lazy-loading 'flavor' on Instance uuid 6598868f-94b6-4429-90ba-8ccf12c92c6c {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:27:53.490943 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-276e34f1-3ddb-4f81-8c42-e0163c488039 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "POST /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c/action" status: 202 len: 0 microversion: 2.1 time: 0.112833 Aug 31 00:27:53.491534 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 516/1031] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:27:53 2022] POST /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:27:53.500472 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:53.501086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:53.507874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:53.508306 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:53.508832 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:53.509517 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:53.510044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:53.511036 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:53.648011 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:53.657239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ed74f97e-64a6-4507-90c6-b2dddf8102bf tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.160599 Aug 31 00:27:53.657799 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 516/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:53 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:54.301082 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-afdab639-5d8b-4f91-8e3c-8bf243729dfe tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bf49e50>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:54.331837 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-afdab639-5d8b-4f91-8e3c-8bf243729dfe tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 200 len: 286 microversion: 2.1 time: 0.034974 Aug 31 00:27:54.332395 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 517/1033] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:54 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:54.677803 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:54.678437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:54.685545 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:54.686055 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:54.686484 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:54.687161 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:54.687603 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:54.688019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:54.814934 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:54.823215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-dcea250a-310a-4407-b7b0-4118b5edcee4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.148814 Aug 31 00:27:54.823789 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 517/1034] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:54 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:55.344824 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-71f7805b-6ddd-4d7d-a27a-583e2f7fcfa3 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bc3da60>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:55.374838 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-71f7805b-6ddd-4d7d-a27a-583e2f7fcfa3 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 200 len: 286 microversion: 2.1 time: 0.034278 Aug 31 00:27:55.375406 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 518/1035] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:55 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:55.844905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:55.845529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:55.852248 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:55.852748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:55.853191 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:55.853958 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:55.854458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:55.854894 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:55.996748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:56.005076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-77ddd39e-3e50-4486-b927-e886e4e010ed tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.164254 Aug 31 00:27:56.005660 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 518/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:55 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:56.388501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0ba46b3d-81d9-4396-849f-25dada7aa95d tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bb06790>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:56.413076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-0ba46b3d-81d9-4396-849f-25dada7aa95d tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] HTTP exception thrown: Snapshot f481b305-e5b6-45bf-89da-49f65f8610dd could not be found. Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0ba46b3d-81d9-4396-849f-25dada7aa95d tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Request method failure captured: Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd HTTP/1.1 Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqsCivdZc52SeMsXfGsHNMhgzxdR_iKhNnRdXhMf1YoUqjtKXpik5gvlr7Qb4Db6CtZsxUptnZROXCV6GX8kMpNJuhVekctI9PlzqOifMNYbQqWgcL-LvYM2Tn_b9oqJT-5DBG4OFkWhN5touEB3rZluSQJow5tzoy4LCvEFXzSKiMw Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 174af9dd587a482fb2ef70d297588e4e Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:27:56.417223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 174af9dd587a482fb2ef70d297588e4e Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-VolumesSnapshotsTestJSON-971355601-project Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 5f750f3d811143bc88269d2ff0b4c1ee Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-VolumesSnapshotsTestJSON-971355601-project Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Snapshot f481b305-e5b6-45bf-89da-49f65f8610dd could not be found. Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': 'f481b305-e5b6-45bf-89da-49f65f8610dd'} Aug 31 00:27:56.419008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f481b305-e5b6-45bf-89da-49f65f8610dd could not be found. (HTTP 404) (Request-ID: req-b50181a8-e42f-450d-bcc2-1a37166820c6) Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:56.420244 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:27:56.421674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f481b305-e5b6-45bf-89da-49f65f8610dd could not be found. Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 00:27:56.423276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f481b305-e5b6-45bf-89da-49f65f8610dd could not be found. Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f481b305-e5b6-45bf-89da-49f65f8610dd could not be found. Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0ba46b3d-81d9-4396-849f-25dada7aa95d tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Returning 404 to user: Snapshot f481b305-e5b6-45bf-89da-49f65f8610dd could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:56.424854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0ba46b3d-81d9-4396-849f-25dada7aa95d tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd" status: 404 len: 111 microversion: 2.1 time: 0.035128 Aug 31 00:27:56.425907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 519/1037] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 31 00:27:56 2022] GET /compute/v2.1/os-snapshots/f481b305-e5b6-45bf-89da-49f65f8610dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:56.427302 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-36dc4081-e1db-4927-aadf-adab5f465be7 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd73616ee0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:56.486945 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-36dc4081-e1db-4927-aadf-adab5f465be7 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644" status: 202 len: 0 microversion: 2.1 time: 0.063375 Aug 31 00:27:56.487540 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 519/1038] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:27:56 2022] DELETE /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:27:56.496127 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-96174b75-d85d-4a80-b244-cd90d34a8ce4 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bd33dc0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:56.543277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-96174b75-d85d-4a80-b244-cd90d34a8ce4 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644" status: 200 len: 344 microversion: 2.1 time: 0.051347 Aug 31 00:27:56.543927 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 520/1039] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:27:56 2022] GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:57.026804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:57.027414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:57.034102 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.034586 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.035022 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.035709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:57.036167 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:57.036588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:57.169144 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:57.177746 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4c62bd0a-f79f-4950-948b-c35dde00ac52 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.155881 Aug 31 00:27:57.178486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 520/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:57 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:57.558628 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-711d494a-d9a1-4101-ba40-3ecbc2f760c5 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bf895e0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:57.586746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-711d494a-d9a1-4101-ba40-3ecbc2f760c5 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] HTTP exception thrown: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-711d494a-d9a1-4101-ba40-3ecbc2f760c5 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Request method failure captured: Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 HTTP/1.1 Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqsCivdZc52SeMsXfGsHNMhgzxdR_iKhNnRdXhMf1YoUqjtKXpik5gvlr7Qb4Db6CtZsxUptnZROXCV6GX8kMpNJuhVekctI9PlzqOifMNYbQqWgcL-LvYM2Tn_b9oqJT-5DBG4OFkWhN5touEB3rZluSQJow5tzoy4LCvEFXzSKiMw Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 174af9dd587a482fb2ef70d297588e4e Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:27:57.589095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 174af9dd587a482fb2ef70d297588e4e Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-VolumesSnapshotsTestJSON-971355601-project Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 5f750f3d811143bc88269d2ff0b4c1ee Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-VolumesSnapshotsTestJSON-971355601-project Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '8744ce5c-dd55-4b7e-9c99-a29ab6a33644'} Aug 31 00:27:57.590787 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. (HTTP 404) (Request-ID: req-44433ce5-fc3e-4c21-a33d-09abe45e5a40) Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:57.591847 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:27:57.593338 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:27:57.595104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-711d494a-d9a1-4101-ba40-3ecbc2f760c5 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Returning 404 to user: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-711d494a-d9a1-4101-ba40-3ecbc2f760c5 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644" status: 404 len: 109 microversion: 2.1 time: 0.036850 Aug 31 00:27:57.596571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 521/1041] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:27:57 2022] GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:57.605462 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a844a482-b3a3-4c5e-afd7-81d4ae30c4c1 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd73616af0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:57.632844 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-a844a482-b3a3-4c5e-afd7-81d4ae30c4c1 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] HTTP exception thrown: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a844a482-b3a3-4c5e-afd7-81d4ae30c4c1 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Request method failure captured: Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: DELETE /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 HTTP/1.1 Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqsCivdZc52SeMsXfGsHNMhgzxdR_iKhNnRdXhMf1YoUqjtKXpik5gvlr7Qb4Db6CtZsxUptnZROXCV6GX8kMpNJuhVekctI9PlzqOifMNYbQqWgcL-LvYM2Tn_b9oqJT-5DBG4OFkWhN5touEB3rZluSQJow5tzoy4LCvEFXzSKiMw Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 174af9dd587a482fb2ef70d297588e4e Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:27:57.634831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 174af9dd587a482fb2ef70d297588e4e Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-VolumesSnapshotsTestJSON-971355601-project Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 5f750f3d811143bc88269d2ff0b4c1ee Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-VolumesSnapshotsTestJSON-971355601-project Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '8744ce5c-dd55-4b7e-9c99-a29ab6a33644'} Aug 31 00:27:57.636486 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. (HTTP 404) (Request-ID: req-6918d6b8-b716-47ed-84f4-9cd589032e43) Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:57.637457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:27:57.638742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:27:57.639946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a844a482-b3a3-4c5e-afd7-81d4ae30c4c1 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Returning 404 to user: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a844a482-b3a3-4c5e-afd7-81d4ae30c4c1 tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644" status: 404 len: 109 microversion: 2.1 time: 0.035351 Aug 31 00:27:57.641447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 521/1042] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:27:57 2022] DELETE /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:57.644667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-07041243-93dd-4444-a806-9c2a727038bd tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Calling method '.version_select at 0x7fcd6bd6fdc0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:57.672592 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-07041243-93dd-4444-a806-9c2a727038bd tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] HTTP exception thrown: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-07041243-93dd-4444-a806-9c2a727038bd tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Request method failure captured: Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 HTTP/1.1 Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqsCivdZc52SeMsXfGsHNMhgzxdR_iKhNnRdXhMf1YoUqjtKXpik5gvlr7Qb4Db6CtZsxUptnZROXCV6GX8kMpNJuhVekctI9PlzqOifMNYbQqWgcL-LvYM2Tn_b9oqJT-5DBG4OFkWhN5touEB3rZluSQJow5tzoy4LCvEFXzSKiMw Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 174af9dd587a482fb2ef70d297588e4e Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:27:57.674670 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_174af9dd587a482fb2ef70d297588e4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 174af9dd587a482fb2ef70d297588e4e Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-971355601 Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-VolumesSnapshotsTestJSON-971355601-project Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 5f750f3d811143bc88269d2ff0b4c1ee Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-VolumesSnapshotsTestJSON-971355601-project Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '8744ce5c-dd55-4b7e-9c99-a29ab6a33644'} Aug 31 00:27:57.676264 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. (HTTP 404) (Request-ID: req-0b49e151-ab41-487c-b949-7ab04414e586) Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:57.677165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:27:57.678407 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:27:57.679669 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-07041243-93dd-4444-a806-9c2a727038bd tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] Returning 404 to user: Volume 8744ce5c-dd55-4b7e-9c99-a29ab6a33644 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-07041243-93dd-4444-a806-9c2a727038bd tempest-VolumesSnapshotsTestJSON-971355601 tempest-VolumesSnapshotsTestJSON-971355601-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644" status: 404 len: 109 microversion: 2.1 time: 0.035165 Aug 31 00:27:57.680926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 522/1043] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:27:57 2022] GET /compute/v2.1/os-volumes/8744ce5c-dd55-4b7e-9c99-a29ab6a33644 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:58.200259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:58.201012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:58.208678 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.209392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.209855 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.210775 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:58.211094 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:58.211701 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:58.483305 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:58.491508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b8d84333-8dff-4601-9a44-d4067a04f010 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.295552 Aug 31 00:27:58.492085 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 522/1044] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:58 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:59.518667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:59.519947 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:27:59.527774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:59.528259 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:59.528803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:59.529497 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:27:59.530050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:27:59.530470 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:27:59.675890 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:27:59.684591 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-959d07a5-3323-49fb-94fb-6ad1dc31bbff tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.171620 Aug 31 00:27:59.685162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 523/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:27:59 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:00.705091 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:00.706273 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:00.712677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.713688 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.714150 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:00.714837 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:00.715284 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:00.715709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:00.852262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:00.860996 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5b84b34c-0484-4f39-a9c9-b524dcd0689e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.159661 Aug 31 00:28:00.861749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 523/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:00 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:01.893983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:01.894595 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:01.901311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:01.901796 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:01.902284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:01.902967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:01.903423 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:01.903850 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:02.041655 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:02.049631 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0277c1a6-6195-46b4-8994-6d096e686003 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.159652 Aug 31 00:28:02.050238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 524/1047] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:01 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:03.071985 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:03.073364 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:03.080601 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:03.081017 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:03.081456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:03.082185 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:03.082659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:03.083113 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:03.235059 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:03.243728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d4e3de68-2dd0-4067-8107-cc972625c59c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.175947 Aug 31 00:28:03.244806 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 524/1048] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:03 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:04.265002 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:04.265674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:04.272152 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:04.272638 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:04.273075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:04.273761 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:04.274241 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:04.274667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:04.408752 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:04.416715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e2dd6dba-e283-430e-a174-7790ef683efc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.155625 Aug 31 00:28:04.417273 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 525/1049] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:04 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:05.436456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:05.437173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:05.443640 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:05.444117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:05.445266 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:05.445991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:05.446440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:05.446879 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:05.585343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:05.593187 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4e6c3ca8-adad-4b4d-98df-8ec0ab55d405 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.160533 Aug 31 00:28:05.593759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 525/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:05 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:06.613494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:06.614271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:06.621021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:06.621493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:06.621942 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:06.622631 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:06.623078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:06.623495 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:06.756310 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:06.764169 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-dcb93a27-ba9b-4169-9650-adaa0593eb1f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.154411 Aug 31 00:28:06.764750 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 526/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:06 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:07.589834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-eef521c6-9dcf-409d-a8d5-e07e53108069 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:07.590385 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-eef521c6-9dcf-409d-a8d5-e07e53108069 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:07.596904 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eef521c6-9dcf-409d-a8d5-e07e53108069 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.597391 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eef521c6-9dcf-409d-a8d5-e07e53108069 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.597829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eef521c6-9dcf-409d-a8d5-e07e53108069 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.598548 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eef521c6-9dcf-409d-a8d5-e07e53108069 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.599010 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eef521c6-9dcf-409d-a8d5-e07e53108069 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.599457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-eef521c6-9dcf-409d-a8d5-e07e53108069 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.622791 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-eef521c6-9dcf-409d-a8d5-e07e53108069 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f/ips" status: 200 len: 149 microversion: 2.1 time: 0.037336 Aug 31 00:28:07.623365 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 526/1052] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:28:07 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:07.634609 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e3c450b-33b0-4fce-ab32-1924a586deb8"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:07.637044 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:07.643008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.643492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.643932 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.644622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.645074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.645501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.724995 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Invalid volume: volume 0e3c450b-33b0-4fce-ab32-1924a586deb8 is already attached to instances: 7bf2e097-da9b-4e83-a63c-bbd6fa880158 Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: POST /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f/os-volume_attachments HTTP/1.1 Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 74 Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:28:07.726633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {"volumeAttachment": {"volumeId": "0e3c450b-33b0-4fce-ab32-1924a586deb8"}} Aug 31 00:28:07.728446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Invalid volume: volume 0e3c450b-33b0-4fce-ab32-1924a586deb8 is already attached to instances: 7bf2e097-da9b-4e83-a63c-bbd6fa880158 Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'server_id': 'b297fa7f-eb55-4948-b66c-8f36ed32041f', 'body': {'volumeAttachment': {'volumeId': '0e3c450b-33b0-4fce-ab32-1924a586deb8'}}} Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0e3c450b-33b0-4fce-ab32-1924a586deb8 is already attached to instances: 7bf2e097-da9b-4e83-a63c-bbd6fa880158 Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:07.729420 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0e3c450b-33b0-4fce-ab32-1924a586deb8 is already attached to instances: 7bf2e097-da9b-4e83-a63c-bbd6fa880158 Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:07.731162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:07.732804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:07.732804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:07.732804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:07.732804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0e3c450b-33b0-4fce-ab32-1924a586deb8 is already attached to instances: 7bf2e097-da9b-4e83-a63c-bbd6fa880158 Aug 31 00:28:07.732804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:07.732804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 400 to user: Invalid volume: volume 0e3c450b-33b0-4fce-ab32-1924a586deb8 is already attached to instances: 7bf2e097-da9b-4e83-a63c-bbd6fa880158 {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:07.732804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6f8b4ca1-b80e-4cfd-b524-cf18b7969ad9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097492 Aug 31 00:28:07.732804 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 527/1053] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:28:07 2022] POST /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 00:28:07.736834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:07.737327 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:07.743162 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.743630 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.744550 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.745222 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.745697 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.746137 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.771779 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:28:07.786293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:07.787155 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:07.802927 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.803467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.804044 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.805359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.805826 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.806902 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.873359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0448dc7d-3771-4d13-a234-eebf92d1317b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 204 len: 0 microversion: 2.1 time: 0.139892 Aug 31 00:28:07.875211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 527/1054] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:28:07 2022] DELETE /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:28:07.885507 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:07.886473 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:07.894170 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.894967 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.895571 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.896447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:07.897262 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:07.898196 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:07.967768 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:07.980564 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-76346b1e-e519-4f1c-9001-ff71276ce24e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.199698 Aug 31 00:28:07.981907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 528/1055] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:07 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:08.051373 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:08.059252 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-930fe79f-7d2f-49a5-9df9-e077e63959f0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1679 microversion: 2.1 time: 0.179419 Aug 31 00:28:08.059813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 528/1056] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:07 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:09.002205 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:09.002717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:09.009206 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.010306 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.010752 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.011462 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.011918 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.012348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.082047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:09.082767 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:09.089911 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.090471 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.090970 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.091721 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:09.092387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:09.092723 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:09.229928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:09.238256 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4ee1e248-7173-44b4-ad0b-0e4da171fa09 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1679 microversion: 2.1 time: 0.160087 Aug 31 00:28:09.238853 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 529/1057] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:09 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:09.475522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:09.483802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5915856a-12d0-470b-85ac-7b3d662f2dc5 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.485676 Aug 31 00:28:09.484373 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 529/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:08 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:10.260643 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:10.263154 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:10.271495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.272872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.273325 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.274481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.275595 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.276027 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.504562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:10.505171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:10.515113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.516447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.517215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.518485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.519381 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.520014 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.565713 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:10.575630 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bf5479ac-8c44-4797-a32c-32c56a12a70b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1679 microversion: 2.1 time: 0.319352 Aug 31 00:28:10.576887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 530/1059] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:10 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1679 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:10.806656 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-d69a65e5-ea0b-4687-8ba9-265fbed2b209 req-70b79dbb-515b-4a51-9255-74df9e26f8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b297fa7f-eb55-4948-b66c-8f36ed32041f", "name": "network-vif-deleted", "tag": "526ca82e-243c-426f-87eb-be7052ec8bba"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:10.808555 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:10.817493 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6b08b126-737f-4feb-b5f7-b633221ef2b2 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1510 microversion: 2.1 time: 0.316639 Aug 31 00:28:10.818406 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 530/1060] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:10 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:10.834560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-d69a65e5-ea0b-4687-8ba9-265fbed2b209 req-70b79dbb-515b-4a51-9255-74df9e26f8bd service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.834560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-d69a65e5-ea0b-4687-8ba9-265fbed2b209 req-70b79dbb-515b-4a51-9255-74df9e26f8bd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.834560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-d69a65e5-ea0b-4687-8ba9-265fbed2b209 req-70b79dbb-515b-4a51-9255-74df9e26f8bd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.841582 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:10.842504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:10.851382 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.852172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.853760 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.868287 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:10.868458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-d69a65e5-ea0b-4687-8ba9-265fbed2b209 req-70b79dbb-515b-4a51-9255-74df9e26f8bd service nova] Creating event network-vif-deleted:526ca82e-243c-426f-87eb-be7052ec8bba for instance b297fa7f-eb55-4948-b66c-8f36ed32041f on hv-cinder-85220 Aug 31 00:28:10.868625 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:10.869040 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:10.879336 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-d69a65e5-ea0b-4687-8ba9-265fbed2b209 req-70b79dbb-515b-4a51-9255-74df9e26f8bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076736 Aug 31 00:28:10.884132 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 531/1061] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:10.907727 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132201) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:28:11.034480 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5965d796-76a1-4ef0-a655-9bfa3d47556b tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "POST /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c/action" status: 202 len: 0 microversion: 2.1 time: 0.197469 Aug 31 00:28:11.035245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 531/1062] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 31 00:28:10 2022] POST /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:28:11.045185 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:11.046171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:11.061422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.062010 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.062811 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.064342 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.065000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.065675 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.257460 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:11.265806 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8a4f54eb-4769-4d47-95b8-7c6e73ee55d8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1518 microversion: 2.1 time: 0.225793 Aug 31 00:28:11.266445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 532/1063] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:11 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:11.599267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:11.600157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:11.607484 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.608066 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.608747 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.609638 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.610411 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.611451 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.665134 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:11.666389 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:11.666829 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:11.667334 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lazy-loading 'fault' on Instance uuid b297fa7f-eb55-4948-b66c-8f36ed32041f {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:28:11.722088 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:11.738878 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3850ca67-3487-42d0-bb64-8dfcc2be6491 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 200 len: 1329 microversion: 2.1 time: 0.144211 Aug 31 00:28:11.740119 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 532/1064] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:11 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 1329 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:12.288284 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:12.288906 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:12.303860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:12.304076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:12.304596 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.309139 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:12.309619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:12.310279 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.393982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-1673ecb7-1a84-4b71-90f0-bbaf7d77415e req-a649b4d1-7deb-4a14-8759-000b51c00fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6598868f-94b6-4429-90ba-8ccf12c92c6c", "name": "network-vif-unplugged", "status": "completed", "tag": "f6ac30ae-f9d0-46c7-b217-0d25aa55a23b"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:12.407299 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-1673ecb7-1a84-4b71-90f0-bbaf7d77415e req-a649b4d1-7deb-4a14-8759-000b51c00fed service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:12.408092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-1673ecb7-1a84-4b71-90f0-bbaf7d77415e req-a649b4d1-7deb-4a14-8759-000b51c00fed service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:12.408627 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-1673ecb7-1a84-4b71-90f0-bbaf7d77415e req-a649b4d1-7deb-4a14-8759-000b51c00fed service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.429006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.compute.server_external_events [req-1673ecb7-1a84-4b71-90f0-bbaf7d77415e req-a649b4d1-7deb-4a14-8759-000b51c00fed service nova] Unable to find a host for instance 6598868f-94b6-4429-90ba-8ccf12c92c6c. Dropping event network-vif-unplugged {{(pid=132201) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 00:28:12.431234 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-1673ecb7-1a84-4b71-90f0-bbaf7d77415e req-a649b4d1-7deb-4a14-8759-000b51c00fed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045577 Aug 31 00:28:12.432319 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 533/1065] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 31 00:28:12.553156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:12.557388 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:12.563190 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6e92d43c-209a-4390-a464-be4e8e11316f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1520 microversion: 2.1 time: 0.279803 Aug 31 00:28:12.563857 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 533/1066] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:12 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:12.760236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:12.760955 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:12.767896 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:12.768384 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:12.768905 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.769624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:12.770153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:12.770662 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:12.785215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f HTTP/1.1 Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:28:12.787477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:28:12.789396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': 'b297fa7f-eb55-4948-b66c-8f36ed32041f'} Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:12.790362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:28:12.792465 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:12.794224 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:12.794224 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bd4298d5-e58f-4975-ad53-7c9c2070c06e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 404 len: 111 microversion: 2.1 time: 0.032879 Aug 31 00:28:12.794224 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 534/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:12 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:12.802305 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-db918e72-c2f9-482e-9707-0d1a8b7ad5a1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '.version_select at 0x7fcd6bd8ddc0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:12.822907 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-db918e72-c2f9-482e-9707-0d1a8b7ad5a1 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231822356" status: 202 len: 0 microversion: 2.1 time: 0.024580 Aug 31 00:28:12.823493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 534/1068] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 31 00:28:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231822356 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:28:13.585473 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:13.585951 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:13.594450 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.595075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.595512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.597697 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.598195 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.599691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.704289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:13.705483 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:13.711911 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.713298 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.713432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.714090 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.714686 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.715115 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.814078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lazy-loading 'services' on Instance uuid 7bf2e097-da9b-4e83-a63c-bbd6fa880158 {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:28:13.844209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:13.852570 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ccd4e6db-761a-4b98-93b3-7229ea505320 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.272071 Aug 31 00:28:13.867065 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 535/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:13 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:13.908520 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-faa8283e-aa2e-4c96-8fe9-00b0d76987cc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-volume_attachments/0e3c450b-33b0-4fce-ab32-1924a586deb8" status: 202 len: 0 microversion: 2.1 time: 0.208616 Aug 31 00:28:13.912622 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 535/1070] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:28:13 2022] DELETE /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-volume_attachments/0e3c450b-33b0-4fce-ab32-1924a586deb8 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:28:13.923651 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bda8da50-e06b-4efb-a3bc-b53dd18da293 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:13.926250 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-bda8da50-e06b-4efb-a3bc-b53dd18da293 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:13.934393 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bda8da50-e06b-4efb-a3bc-b53dd18da293 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.935346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bda8da50-e06b-4efb-a3bc-b53dd18da293 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.936146 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bda8da50-e06b-4efb-a3bc-b53dd18da293 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.936990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bda8da50-e06b-4efb-a3bc-b53dd18da293 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:13.937713 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bda8da50-e06b-4efb-a3bc-b53dd18da293 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:13.938424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-bda8da50-e06b-4efb-a3bc-b53dd18da293 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:13.961829 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:13.983148 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bda8da50-e06b-4efb-a3bc-b53dd18da293 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064045 Aug 31 00:28:13.983970 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 536/1071] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:28:13 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:14.876272 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:14.877028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:14.883896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:14.885077 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:14.885704 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:14.887597 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:14.887801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:14.888295 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:14.995926 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-57c5c826-7a26-4185-87dc-3e1491c8de32 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:14.998250 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-57c5c826-7a26-4185-87dc-3e1491c8de32 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:15.004871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57c5c826-7a26-4185-87dc-3e1491c8de32 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.005367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57c5c826-7a26-4185-87dc-3e1491c8de32 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.006138 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57c5c826-7a26-4185-87dc-3e1491c8de32 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.007015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57c5c826-7a26-4185-87dc-3e1491c8de32 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.008676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57c5c826-7a26-4185-87dc-3e1491c8de32 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.009365 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-57c5c826-7a26-4185-87dc-3e1491c8de32 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.040099 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-57c5c826-7a26-4185-87dc-3e1491c8de32 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048106 Aug 31 00:28:15.040769 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 537/1072] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:28:14 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 00:28:15.046421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:15.055270 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3d5ff54c-656d-462f-ac2f-9e070387933c tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.183466 Aug 31 00:28:15.056648 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 536/1073] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:14 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:15.105087 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:15.105460 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:15.111672 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.112164 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.112665 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.113374 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.113830 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.114341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.140015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:28:15.222288 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ffc89262-4ded-44c1-b048-9c8e90882275 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 204 len: 0 microversion: 2.1 time: 0.120876 Aug 31 00:28:15.222882 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 538/1074] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:28:15 2022] DELETE /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:28:15.232396 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:15.233474 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:15.239565 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.240046 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.240490 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.241188 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:15.241640 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:15.242101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:15.375856 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:15.384093 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8014bc07-cd31-499a-b47f-f6e378754a66 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1680 microversion: 2.1 time: 0.156503 Aug 31 00:28:15.384755 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 537/1075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:15 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:16.077519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:16.078351 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:16.085210 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.085693 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.086155 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.086854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.087832 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.088285 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.228418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:16.236173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cad2b1f5-d6e0-4e21-a0a6-6ee94ce42fa4 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.163067 Aug 31 00:28:16.236740 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 539/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:16 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:16.404533 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:16.405143 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:16.411764 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.412245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.412685 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.413441 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:16.413817 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:16.414784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:16.546708 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:16.554769 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a36b4605-bd72-4761-9306-650adb4cadfc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1680 microversion: 2.1 time: 0.154088 Aug 31 00:28:16.555442 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 538/1077] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:16 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:17.256507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:17.257125 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:17.264124 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.264850 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.265293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.266025 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.266481 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.266909 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.489283 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:17.498282 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1fc8df2e-2ab3-4797-b078-197c4771e96a tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.245619 Aug 31 00:28:17.498861 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 540/1078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:17 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:17.576770 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:17.577493 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:17.584168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.584748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.585259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.586053 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:17.586600 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:17.587119 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:17.721092 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:17.729807 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0a3f5aab-747f-4270-b263-bef577ddcfba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1680 microversion: 2.1 time: 0.156899 Aug 31 00:28:17.730547 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 539/1079] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:17 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:18.032897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-a649c14d-b455-4cc4-ba30-8e0d2550e229 req-a2632e4f-ad70-4de0-8dec-942e7d7adfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf2e097-da9b-4e83-a63c-bbd6fa880158", "name": "network-vif-deleted", "tag": "6d187a0d-3cb9-4e2e-8bff-83480e41ed84"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:18.045459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-a649c14d-b455-4cc4-ba30-8e0d2550e229 req-a2632e4f-ad70-4de0-8dec-942e7d7adfd6 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:18.046066 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-a649c14d-b455-4cc4-ba30-8e0d2550e229 req-a2632e4f-ad70-4de0-8dec-942e7d7adfd6 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:18.046509 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-a649c14d-b455-4cc4-ba30-8e0d2550e229 req-a2632e4f-ad70-4de0-8dec-942e7d7adfd6 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:18.058562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-a649c14d-b455-4cc4-ba30-8e0d2550e229 req-a2632e4f-ad70-4de0-8dec-942e7d7adfd6 service nova] Creating event network-vif-deleted:6d187a0d-3cb9-4e2e-8bff-83480e41ed84 for instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 on hv-cinder-85220 Aug 31 00:28:18.063449 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-a649c14d-b455-4cc4-ba30-8e0d2550e229 req-a2632e4f-ad70-4de0-8dec-942e7d7adfd6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034438 Aug 31 00:28:18.064085 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 541/1080] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:18.520637 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:18.521239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:18.527709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:18.528495 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:18.529133 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:18.529830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:18.530302 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:18.530948 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:18.672269 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:18.687311 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6211f4e8-0b85-422c-8580-f1c6881ca6b3 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.170421 Aug 31 00:28:18.688401 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 540/1081] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:18 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:18.753573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:18.754460 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:18.760667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:18.761160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:18.761596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:18.762323 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:18.762774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:18.763197 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:18.828525 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:18.836630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ed9c4175-c672-4ff2-93a4-35b5fcb828a4 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1612 microversion: 2.1 time: 0.087662 Aug 31 00:28:18.837521 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 542/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:18 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1612 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:19.709807 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:19.710440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:19.716843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:19.717319 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:19.717749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:19.718465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:19.718917 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:19.719337 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:19.848046 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:19.856695 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-bc3329da-971d-4864-bfbe-97f24ac5a997 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.150691 Aug 31 00:28:19.857541 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 541/1083] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:19 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:19.858665 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:19.859285 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:19.865801 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:19.866320 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:19.866755 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:19.867448 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:19.867897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:19.868321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:19.930990 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:19.938456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ddf68f4f-b377-4c2c-9cc0-330c3c873dae tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1326 microversion: 2.1 time: 0.083714 Aug 31 00:28:19.939016 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 543/1084] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:19 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1326 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:20.877411 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:20.878073 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:20.885378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.885994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.886440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.887104 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.887581 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.888011 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.959591 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:20.960204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:20.967545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.968033 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.968464 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:20.969163 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:20.969613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:20.970070 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:21.002507 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:21.002989 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:21.003430 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:21.003878 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lazy-loading 'fault' on Instance uuid 7bf2e097-da9b-4e83-a63c-bbd6fa880158 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:28:21.026667 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:21.034478 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ed2e41f1-f921-4d80-b93a-8c619ead6692 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.160941 Aug 31 00:28:21.035050 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 542/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:20 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:21.046821 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:21.054562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d87a4c50-b121-4e91-9da7-62f4e849a0f2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 200 len: 1331 microversion: 2.1 time: 0.098901 Aug 31 00:28:21.055126 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 544/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:20 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:22.056331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:22.056942 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:22.063554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.064040 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.064476 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:22.065177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.065630 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.066081 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:22.076691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:22.077500 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:22.084243 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.084802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.085308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:22.086118 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:22.086642 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:22.087667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:22.102145 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 HTTP/1.1 Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:28:22.104573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:28:22.106474 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '7bf2e097-da9b-4e83-a63c-bbd6fa880158'} Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:22.107399 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:28:22.108971 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:22.110531 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:22.110531 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-21209a0f-6006-40fe-8f11-e530c23413cd tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 404 len: 111 microversion: 2.1 time: 0.033510 Aug 31 00:28:22.110694 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 545/1087] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:22 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:28:22.115348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b0535108-9c42-46f1-a88d-d8caae1c8777 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '.version_select at 0x7fcd70bd2ca0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:22.134278 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b0535108-9c42-46f1-a88d-d8caae1c8777 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925210269" status: 202 len: 0 microversion: 2.1 time: 0.021945 Aug 31 00:28:22.134854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 546/1088] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 31 00:28:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925210269 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:28:22.205914 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:22.214789 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-65d64c67-4a35-47eb-972b-ac1c9a2f20f1 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.162896 Aug 31 00:28:22.215765 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 543/1089] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:22 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:22.747165 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-df049be5-34ec-453b-a929-77a47843e94d tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: .version_select at 0x7fcd6bc3dc10>, body: {"keypair": {"name": "tempest-keypair-1298416312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB8fSO72XjeGnYmstMw3g742M5Ns7wOyiy9HEhZ9jVJX5yg8uLBw6cGiJeyLldbAt17LTaKzIQoFJkJUNxP4yrLf8gRyfOlH+08gv1u4YUHXD+l/xfLbt/Ccn64SDYiWQ=="}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:22.763111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-df049be5-34ec-453b-a929-77a47843e94d tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'key_pairs'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:28:22.766978 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-df049be5-34ec-453b-a929-77a47843e94d tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for user 988168279e8e495a985e209a35764f2b and project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'key_pairs'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:28:22.789487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-df049be5-34ec-453b-a929-77a47843e94d tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046252 Aug 31 00:28:22.790193 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 547/1090] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:28:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:23.235974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:23.236590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:23.243587 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:23.244082 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:23.244504 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:23.245182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:23.245626 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:23.246071 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:23.384749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:23.393215 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a261a22a-52d6-4cb6-89ba-8d1d4d6fbc7e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.161189 Aug 31 00:28:23.393801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 544/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:23 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:24.319012 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-18025699", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c68b95b5-2004-4926-97ca-43c398029473"}], "security_groups": [{"name": "tempest-securitygroup--257733531"}], "key_name": "tempest-keypair-1298416312", "user_data": "}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:24.329933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:24.415876 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:24.416670 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:24.422766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:24.424407 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:24.424971 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:24.425520 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:24.426318 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:24.426865 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:24.427381 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:24.431512 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] validate_networks() for [('c68b95b5-2004-4926-97ca-43c398029473', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:28:24.571952 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:24.579615 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ed38acf5-7243-4631-8d4c-82f0a6fa2266 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.168525 Aug 31 00:28:24.580183 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 545/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:24 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:24.584507 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-d9cf3523-ddf2-4ae8-b888-c53111245de2 req-a679795b-6c7a-4669-9edf-3b0efe3b7041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6598868f-94b6-4429-90ba-8ccf12c92c6c", "name": "network-vif-plugged", "status": "completed", "tag": "f6ac30ae-f9d0-46c7-b217-0d25aa55a23b"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:24.594492 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-d9cf3523-ddf2-4ae8-b888-c53111245de2 req-a679795b-6c7a-4669-9edf-3b0efe3b7041 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:24.594864 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-d9cf3523-ddf2-4ae8-b888-c53111245de2 req-a679795b-6c7a-4669-9edf-3b0efe3b7041 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:24.595286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-d9cf3523-ddf2-4ae8-b888-c53111245de2 req-a679795b-6c7a-4669-9edf-3b0efe3b7041 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:24.606637 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-d9cf3523-ddf2-4ae8-b888-c53111245de2 req-a679795b-6c7a-4669-9edf-3b0efe3b7041 service nova] Creating event network-vif-plugged:f6ac30ae-f9d0-46c7-b217-0d25aa55a23b for instance 6598868f-94b6-4429-90ba-8ccf12c92c6c on hv-cinder-85220 Aug 31 00:28:24.611575 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-d9cf3523-ddf2-4ae8-b888-c53111245de2 req-a679795b-6c7a-4669-9edf-3b0efe3b7041 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030308 Aug 31 00:28:24.612161 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 546/1093] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:24.824492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:28:24.824920 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:28:24.825398 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:28:24.825807 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:28:24.826246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:28:24.835770 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:24.836248 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:24.836689 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:24.837418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:24.837922 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:24.838347 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:24.855274 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:28:24.859259 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for user 988168279e8e495a985e209a35764f2b and project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:28:24.871405 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:28:24.873730 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:28:24.920232 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cff17d6f-bbf4-4705-912e-7d2d39c3176c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.608446 Aug 31 00:28:24.920878 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 548/1094] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:28:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:28:24.933304 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5008b428-efef-41c0-bc61-f8ec2ed6cd02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:24.934211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5008b428-efef-41c0-bc61-f8ec2ed6cd02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:24.992094 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5008b428-efef-41c0-bc61-f8ec2ed6cd02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:24.999826 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5008b428-efef-41c0-bc61-f8ec2ed6cd02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1240 microversion: 2.1 time: 0.071463 Aug 31 00:28:25.000395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 547/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:24 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:25.298255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905331752", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-903737389", "security_groups": [{"name": "tempest-secgroup-smoke-1230119711"}], "block_device_mapping_v2": [{"uuid": "9b444a7a-7091-4f7b-8a44-56fd0084f8f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4c2507f0-77f6-4977-b074-6f8caa46b647"}]}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:25.427630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] validate_networks() for [('4c2507f0-77f6-4977-b074-6f8caa46b647', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:28:25.600512 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:25.601289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:25.608245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.608665 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.609099 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.609792 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.610275 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.610701 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.747275 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:25.757354 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ebd21c6c-66fa-4730-9d72-6c52c687c475 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1576 microversion: 2.1 time: 0.160660 Aug 31 00:28:25.770523 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 548/1096] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:25 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:25.832171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:28:25.832171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:28:25.832664 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:28:25.833088 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:28:25.833499 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:28:25.842324 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.842792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.843228 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.843975 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:25.844427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:25.844864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:25.862667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Getting quotas for project 167da5798ea2451a9888a661b3c7f3e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:28:25.866648 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Getting quotas for user 5d8054341c0e46778e3b3db0b3dd1164 and project 167da5798ea2451a9888a661b3c7f3e6. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:28:25.926442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:28:25.928834 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b444a7a-7091-4f7b-8a44-56fd0084f8f1',volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:28:26.020758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:26.021525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:26.027598 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:26.028163 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:26.028677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:26.029505 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:26.030062 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:26.030559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:26.060515 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9f10c34e-8fb3-41f7-973e-72c1e90d4c8e tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766582 Aug 31 00:28:26.066972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 549/1097] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:28:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:28:26.075641 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d66c843c-92d2-40de-a43f-224f57e344a3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:26.076248 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d66c843c-92d2-40de-a43f-224f57e344a3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:26.097414 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:26.113509 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5f2d0694-2a69-476b-80ec-28d96d6f1a3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1292 microversion: 2.1 time: 0.096478 Aug 31 00:28:26.114043 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 549/1098] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:26 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:26.130620 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d66c843c-92d2-40de-a43f-224f57e344a3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:26.138009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d66c843c-92d2-40de-a43f-224f57e344a3 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1094 microversion: 2.1 time: 0.066997 Aug 31 00:28:26.138577 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 550/1099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:26 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:26.780942 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:26.781339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:26.787863 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:26.788341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:26.789039 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:26.789765 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:26.790233 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:26.790648 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:26.924168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:26.932645 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a9654871-9c79-46b2-8aa6-a275673aaf22 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1563 microversion: 2.1 time: 0.156259 Aug 31 00:28:26.933222 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 550/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:26 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:27.134955 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:27.135521 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:27.142940 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:27.143562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:27.144022 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:27.144722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:27.145180 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:27.145609 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:27.157512 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:27.158469 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:27.166210 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:27.171237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:27.172833 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:27.175485 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:27.176211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:27.176985 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:27.250197 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:27.260743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-00c4aac0-65e1-4718-9e5b-18a73d09f684 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1300 microversion: 2.1 time: 0.129864 Aug 31 00:28:27.261667 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 551/1101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:27 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:27.267924 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:27.277340 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-222abfe9-67db-465a-b173-f36e218ee07b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1192 microversion: 2.1 time: 0.123874 Aug 31 00:28:27.286619 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 551/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:27 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1192 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:28.283886 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:28.284767 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:28.299638 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:28.300881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:28.305251 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.310359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.312155 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.312677 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.312974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.313694 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.315259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.315889 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.316129 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.318777 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:28.319500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:28.320113 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:28.371933 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:28.595820 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:28.626153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6dded1fa-f4f0-4a98-b927-ff23da1fb3d5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1365 microversion: 2.1 time: 0.344085 Aug 31 00:28:28.627162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 552/1103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:28 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:28.735109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:28.747730 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ed8bc9b2-9db8-471b-b1e9-e63b85f2a84a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1210 microversion: 2.1 time: 0.452831 Aug 31 00:28:28.748399 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 552/1104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:28 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1210 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:29.171774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-e4d9bf6e-d1ff-4de3-898f-e24bdd71709b req-bc3bbe16-bc74-4a04-bd17-744f740102e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6c5476-e889-42b0-a0e9-abd3044c4031", "tag": "14fe4cc5-6472-4715-a6a8-33e8cb4f97c6"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:29.187007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-e4d9bf6e-d1ff-4de3-898f-e24bdd71709b req-bc3bbe16-bc74-4a04-bd17-744f740102e3 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.187487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-e4d9bf6e-d1ff-4de3-898f-e24bdd71709b req-bc3bbe16-bc74-4a04-bd17-744f740102e3 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.190254 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-e4d9bf6e-d1ff-4de3-898f-e24bdd71709b req-bc3bbe16-bc74-4a04-bd17-744f740102e3 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.210639 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-e4d9bf6e-d1ff-4de3-898f-e24bdd71709b req-bc3bbe16-bc74-4a04-bd17-744f740102e3 service nova] Creating event network-changed:14fe4cc5-6472-4715-a6a8-33e8cb4f97c6 for instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 on hv-cinder-85220 Aug 31 00:28:29.235236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-e4d9bf6e-d1ff-4de3-898f-e24bdd71709b req-bc3bbe16-bc74-4a04-bd17-744f740102e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067213 Aug 31 00:28:29.236580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 553/1105] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:29.649044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:29.651407 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:29.664162 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.666032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.666711 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.667671 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.668806 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.670178 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.769666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:29.771613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:29.781797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.782706 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.786131 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.787102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:29.788082 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:29.789580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:29.940881 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:29.942501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:29.949359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-43c4051d-2a09-4666-af16-56d9193fbdab tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.184424 Aug 31 00:28:29.950259 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 554/1106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:29 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:29.962265 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-54d5308c-344b-4070-95fb-eff1c0a9ca72 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1365 microversion: 2.1 time: 0.311191 Aug 31 00:28:29.962265 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 553/1107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:29 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:30.039416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-c9dda640-4bd3-470f-9d63-dc434b1b38f5 req-714ff0bd-0c1d-429d-b9f1-2dfbec63336c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0258002a-8a09-4ef0-94de-a15ac1ea23aa", "tag": "8e99088b-8e89-4696-9dda-e1a593be3444"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:30.049423 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-c9dda640-4bd3-470f-9d63-dc434b1b38f5 req-714ff0bd-0c1d-429d-b9f1-2dfbec63336c service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.049936 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-c9dda640-4bd3-470f-9d63-dc434b1b38f5 req-714ff0bd-0c1d-429d-b9f1-2dfbec63336c service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.050366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-c9dda640-4bd3-470f-9d63-dc434b1b38f5 req-714ff0bd-0c1d-429d-b9f1-2dfbec63336c service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.062178 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-c9dda640-4bd3-470f-9d63-dc434b1b38f5 req-714ff0bd-0c1d-429d-b9f1-2dfbec63336c service nova] Creating event network-changed:8e99088b-8e89-4696-9dda-e1a593be3444 for instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa on hv-cinder-85220 Aug 31 00:28:30.067858 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-c9dda640-4bd3-470f-9d63-dc434b1b38f5 req-714ff0bd-0c1d-429d-b9f1-2dfbec63336c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032647 Aug 31 00:28:30.068609 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 554/1108] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:30.972793 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:30.973413 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:30.979413 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:30.980675 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:30.981093 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.981731 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.982198 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.983345 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.984043 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.985487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.989022 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.989435 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.990108 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:30.990983 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:30.991614 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:30.992210 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:31.229287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:31.240828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0901136d-1e9d-4503-9ddf-46e308deb576 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1365 microversion: 2.1 time: 0.267878 Aug 31 00:28:31.245379 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 555/1109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:30 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:31.275348 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:31.293704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-316e984c-82b0-423d-9e6b-00aec5a0081a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.326303 Aug 31 00:28:31.294916 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 555/1110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:30 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:32.264659 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:32.265269 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:32.272491 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:32.272973 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:32.273405 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:32.274613 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:32.275069 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:32.275489 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:32.314171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:32.314892 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:32.321431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:32.322047 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:32.322562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:32.323343 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:32.323873 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:32.324375 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:32.407076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:32.416888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b5d6ab54-6228-416f-b8b7-35435ee8da8b tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1365 microversion: 2.1 time: 0.156131 Aug 31 00:28:32.417802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 556/1111] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:32 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:32.463805 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:32.471586 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-1076c1cb-1703-4087-a6b6-2623cf46452a tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.161183 Aug 31 00:28:32.472155 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 556/1112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:32 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:32.835802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-935504790", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "networks": [{"uuid": "ae2312b0-f506-47f8-8559-afa786d6ea94"}]}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:32.888391 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.network.neutron [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] validate_networks() for [('ae2312b0-f506-47f8-8559-afa786d6ea94', None, None, None, None, None)] {{(pid=132200) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:28:33.239711 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Flavor limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:28:33.240204 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Image limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:28:33.240925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Flavor pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:28:33.241346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Image pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:28:33.241760 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:28:33.250970 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.251395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.251828 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.252550 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.253009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.253422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.270358 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Getting quotas for project a1a6554fb0f242c18cd475cad255d5c5. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:28:33.274804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Getting quotas for user 928feb4832ed4d42a765bdd393cbefa6 and project a1a6554fb0f242c18cd475cad255d5c5. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:28:33.285721 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Going to run 1 instances... {{(pid=132200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:28:33.287997 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:28:33.331632 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [938bb642-5250-4c2a-8a0e-996b19f385a1] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 00:28:33.437568 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:33.438204 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:33.444624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.445107 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.446061 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.446748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.447197 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.447622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.465967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:33.576652 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:33.586131 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4e989c4b-97bc-40eb-b6ac-84be14b3e776 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1365 microversion: 2.1 time: 0.152275 Aug 31 00:28:33.587277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 557/1113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:33 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:33.591666 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:33.592263 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:33.598167 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.598996 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.599354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.600364 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:33.600822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:33.601257 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:33.729967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:33.737535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8076d4d5-2b24-4a58-92b9-f7f3d1c62ca8 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.149319 Aug 31 00:28:33.738170 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 558/1114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:33 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:34.339995 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO oslo.messaging._drivers.impl_rabbit [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [938bb642-5250-4c2a-8a0e-996b19f385a1] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40372. Aug 31 00:28:34.343747 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-3ea581df-63ea-45e3-9524-bbe2265ac7ea tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.511820 Aug 31 00:28:34.344396 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 557/1115] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:28:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:28:34.355008 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-28bddb86-d9d3-4bcf-abe5-c425cc666553 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:34.355647 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-28bddb86-d9d3-4bcf-abe5-c425cc666553 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:34.408265 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-28bddb86-d9d3-4bcf-abe5-c425cc666553 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:34.415404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-28bddb86-d9d3-4bcf-abe5-c425cc666553 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1213 microversion: 2.1 time: 0.064213 Aug 31 00:28:34.415975 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 559/1116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:34 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:34.532607 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-36d73943-674a-42a1-9f6f-598e8c4af5d6 req-7339e7bb-0658-4acf-87d5-867ec9d015b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6c5476-e889-42b0-a0e9-abd3044c4031", "name": "network-vif-plugged", "status": "completed", "tag": "14fe4cc5-6472-4715-a6a8-33e8cb4f97c6"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:34.543113 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-36d73943-674a-42a1-9f6f-598e8c4af5d6 req-7339e7bb-0658-4acf-87d5-867ec9d015b3 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:34.543783 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-36d73943-674a-42a1-9f6f-598e8c4af5d6 req-7339e7bb-0658-4acf-87d5-867ec9d015b3 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:34.544226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-36d73943-674a-42a1-9f6f-598e8c4af5d6 req-7339e7bb-0658-4acf-87d5-867ec9d015b3 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:34.556596 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-36d73943-674a-42a1-9f6f-598e8c4af5d6 req-7339e7bb-0658-4acf-87d5-867ec9d015b3 service nova] Creating event network-vif-plugged:14fe4cc5-6472-4715-a6a8-33e8cb4f97c6 for instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 on hv-cinder-85220 Aug 31 00:28:34.561378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-36d73943-674a-42a1-9f6f-598e8c4af5d6 req-7339e7bb-0658-4acf-87d5-867ec9d015b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033571 Aug 31 00:28:34.562144 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 558/1117] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:34.608520 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:34.609129 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:34.617803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:34.618303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:34.618925 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:34.619961 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:34.620616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:34.621050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:34.759066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:34.760504 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:34.767057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:34.768580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:34.769101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:34.769809 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:34.770335 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:34.770767 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:34.813001 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:34.824136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-aef3c83a-2d59-497e-af25-97c09c881c02 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1365 microversion: 2.1 time: 0.219383 Aug 31 00:28:34.824924 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 560/1118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:34 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:34.920395 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:34.928241 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-87ffbbe3-d3a9-423d-a158-209a5b8f5151 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.173817 Aug 31 00:28:34.928801 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 559/1119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:34 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:35.436018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:35.436630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:35.442690 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:35.443167 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:35.443603 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:35.444322 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:35.444772 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:35.445193 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:35.506823 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:35.515759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2aa0d21f-4ade-4494-bc6c-8892e19d2fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1265 microversion: 2.1 time: 0.083584 Aug 31 00:28:35.516339 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 561/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:35 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:35.846174 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:35.846783 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:35.853727 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:35.854255 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:35.854915 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:35.855611 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:35.856066 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:35.856489 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:35.948522 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:35.949223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:35.951699 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=4 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:35.957137 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:35.957618 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:35.958085 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:35.958783 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:35.959235 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:35.959660 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:35.987286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:35.995566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-db09596d-6580-4246-bf99-02bc39f45754 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1365 microversion: 2.1 time: 0.153332 Aug 31 00:28:35.996127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 560/1121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:35 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:36.088736 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:36.096457 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-0ece01cb-471f-476c-be7b-451ee7941271 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.151732 Aug 31 00:28:36.097023 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 562/1122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:35 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:36.536522 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:36.537239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:36.543503 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:36.543989 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:36.544430 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:36.545117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:36.545570 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:36.546025 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:36.610447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:36.618165 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-98e5fb5d-563a-44e3-8437-601e5fd14ba4 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1273 microversion: 2.1 time: 0.085496 Aug 31 00:28:36.618731 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 561/1123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:36 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:37.016132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.016726 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:37.022983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.023459 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.023893 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.024576 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.025028 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.025451 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.117782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.118571 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:37.125359 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.125869 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.126319 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.127032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.127484 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.127910 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.274265 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:37.282243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7ff4607d-f292-48b6-96fe-4681a3bd7636 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.169092 Aug 31 00:28:37.282834 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 562/1124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:37 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:37.519657 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:37.527468 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2bd5550a-e61a-49ea-a7cc-6532cab1b459 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1555 microversion: 2.1 time: 0.515266 Aug 31 00:28:37.528035 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 563/1125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:37 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1555 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:37.547649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-c630e906-5b09-4b6f-969d-50e82d4152f5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.548169 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-c630e906-5b09-4b6f-969d-50e82d4152f5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:37.554160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c630e906-5b09-4b6f-969d-50e82d4152f5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.555147 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c630e906-5b09-4b6f-969d-50e82d4152f5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.555561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c630e906-5b09-4b6f-969d-50e82d4152f5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.556243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c630e906-5b09-4b6f-969d-50e82d4152f5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.556692 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c630e906-5b09-4b6f-969d-50e82d4152f5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.557114 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-c630e906-5b09-4b6f-969d-50e82d4152f5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.632106 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-c630e906-5b09-4b6f-969d-50e82d4152f5 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088373 Aug 31 00:28:37.632736 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 563/1126] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 31 00:28:37 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:37.640102 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.640719 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:37.646792 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.647279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.647711 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.648496 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:37.648951 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:37.649378 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:37.710108 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:37.717812 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ac44b98c-b2e3-457d-ad45-eba7e326be59 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1271 microversion: 2.1 time: 0.082272 Aug 31 00:28:37.718519 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 564/1127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:37 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:38.303343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:38.303963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:38.310330 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.310824 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.311266 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.312001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.312458 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.312885 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.502743 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:38.510565 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-fe86a87a-a01e-4c98-b5d1-49e9668fa12c tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.211608 Aug 31 00:28:38.520877 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 564/1128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:38 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:38.650993 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-0e1fe57c-b286-48a0-8d78-72fb396b2169 req-b83cd4a9-2c88-45b4-99d9-d4ff6a802f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6c5476-e889-42b0-a0e9-abd3044c4031", "tag": "14fe4cc5-6472-4715-a6a8-33e8cb4f97c6"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:38.661006 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-0e1fe57c-b286-48a0-8d78-72fb396b2169 req-b83cd4a9-2c88-45b4-99d9-d4ff6a802f2e service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.661564 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-0e1fe57c-b286-48a0-8d78-72fb396b2169 req-b83cd4a9-2c88-45b4-99d9-d4ff6a802f2e service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.662112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-0e1fe57c-b286-48a0-8d78-72fb396b2169 req-b83cd4a9-2c88-45b4-99d9-d4ff6a802f2e service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.674496 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-0e1fe57c-b286-48a0-8d78-72fb396b2169 req-b83cd4a9-2c88-45b4-99d9-d4ff6a802f2e service nova] Creating event network-changed:14fe4cc5-6472-4715-a6a8-33e8cb4f97c6 for instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 on hv-cinder-85220 Aug 31 00:28:38.681203 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-0e1fe57c-b286-48a0-8d78-72fb396b2169 req-b83cd4a9-2c88-45b4-99d9-d4ff6a802f2e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034361 Aug 31 00:28:38.682414 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 565/1129] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:38.739880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:38.740960 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:38.765962 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.767590 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.768610 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:38.770715 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:38.772248 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:38.773459 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:39.034579 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:39.045951 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-b16e0c0d-6185-4a17-80d2-7e5b29d9e761 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1313 microversion: 2.1 time: 0.310851 Aug 31 00:28:39.047257 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 565/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:38 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:39.473476 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-aaa239df-43cf-4908-aba2-e6a446687243 req-a8f5fddc-083a-42b2-94e2-f1dc285ca9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344293b6-3291-4a4c-a440-8d8c97366cdb", "tag": "8cc27005-4124-4708-ac58-0eb4833c536e"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:39.489684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-aaa239df-43cf-4908-aba2-e6a446687243 req-a8f5fddc-083a-42b2-94e2-f1dc285ca9b5 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:39.490640 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-aaa239df-43cf-4908-aba2-e6a446687243 req-a8f5fddc-083a-42b2-94e2-f1dc285ca9b5 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:39.492159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-aaa239df-43cf-4908-aba2-e6a446687243 req-a8f5fddc-083a-42b2-94e2-f1dc285ca9b5 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:39.503349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-aaa239df-43cf-4908-aba2-e6a446687243 req-a8f5fddc-083a-42b2-94e2-f1dc285ca9b5 service nova] Creating event network-changed:8cc27005-4124-4708-ac58-0eb4833c536e for instance 344293b6-3291-4a4c-a440-8d8c97366cdb on hv-cinder-85220 Aug 31 00:28:39.510803 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-aaa239df-43cf-4908-aba2-e6a446687243 req-a8f5fddc-083a-42b2-94e2-f1dc285ca9b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040381 Aug 31 00:28:39.513391 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 566/1131] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:39.532578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:39.533180 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:39.539910 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:39.540542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:39.540804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:39.541485 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:39.541955 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:39.542376 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:39.692398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:39.701326 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-63b95558-bb88-417f-88b0-09c0be5c9a4b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.172521 Aug 31 00:28:39.702278 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 566/1132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:39 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:40.067808 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:40.068417 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:40.075515 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:40.075987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:40.076418 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:40.077095 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:40.077571 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:40.078012 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:40.203800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:40.212092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2236472f-1975-4f59-91ea-043f1512fa2c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1313 microversion: 2.1 time: 0.148545 Aug 31 00:28:40.212646 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 567/1133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:40 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:40.722670 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:40.723312 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:40.730522 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:40.731000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:40.731434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:40.732120 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:40.732571 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:40.732994 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:40.862168 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:40.870019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ed6f3866-b935-4c79-9074-171ada1a3e26 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.151202 Aug 31 00:28:40.870583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 567/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:40 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:41.233038 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:41.233647 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:41.240487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:41.240979 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:41.241455 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:41.242812 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:41.243271 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:41.243702 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:41.458228 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:41.466456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-970aece7-f84a-471f-aedd-0ff21a071fa5 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1313 microversion: 2.1 time: 0.237315 Aug 31 00:28:41.467116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 568/1135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:41 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:41.891044 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:41.891593 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:41.898052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:41.899134 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:41.899559 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:41.900249 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:41.900704 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:41.901131 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:42.262288 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:42.269989 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0fa14967-7b27-46cb-8f48-b63ea94eb088 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.382803 Aug 31 00:28:42.270560 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 568/1136] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:41 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:42.487362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:42.488089 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:42.494447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:42.494927 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:42.495358 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:42.496051 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:42.496492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:42.496908 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:42.630979 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:42.639637 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-07edf49a-af92-40f1-89ff-2c8b08c2d699 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1313 microversion: 2.1 time: 0.156122 Aug 31 00:28:42.640355 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 569/1137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:42 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:42.755378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-a07c006a-1247-4e9e-ba67-782496b6f9cf req-158c8909-cb04-4991-b997-5ec8c99787b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0258002a-8a09-4ef0-94de-a15ac1ea23aa", "name": "network-vif-plugged", "status": "completed", "tag": "8e99088b-8e89-4696-9dda-e1a593be3444"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:42.764829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-a07c006a-1247-4e9e-ba67-782496b6f9cf req-158c8909-cb04-4991-b997-5ec8c99787b7 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:42.765302 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-a07c006a-1247-4e9e-ba67-782496b6f9cf req-158c8909-cb04-4991-b997-5ec8c99787b7 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:42.765732 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-a07c006a-1247-4e9e-ba67-782496b6f9cf req-158c8909-cb04-4991-b997-5ec8c99787b7 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:42.779429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-a07c006a-1247-4e9e-ba67-782496b6f9cf req-158c8909-cb04-4991-b997-5ec8c99787b7 service nova] Creating event network-vif-plugged:8e99088b-8e89-4696-9dda-e1a593be3444 for instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa on hv-cinder-85220 Aug 31 00:28:42.784722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-a07c006a-1247-4e9e-ba67-782496b6f9cf req-158c8909-cb04-4991-b997-5ec8c99787b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032978 Aug 31 00:28:42.785502 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 569/1138] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:43.293127 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:43.293914 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:43.300104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:43.300592 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:43.301024 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:43.301735 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:43.302214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:43.302643 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:43.441068 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:43.449072 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9698026a-a56b-48f1-947b-12306c0aa049 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.160635 Aug 31 00:28:43.449723 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 570/1139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:43 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:43.658456 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:43.659135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=8 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:43.664557 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:43.665260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:43.672583 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:43.673074 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:43.673510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:43.674229 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:43.674909 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:43.675343 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:43.805135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:43.812991 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-016fc557-f217-4911-871d-a653c040e0fd tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1313 microversion: 2.1 time: 0.156146 Aug 31 00:28:43.813582 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 570/1140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:43 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:44.470068 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:44.470839 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:44.473506 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=20 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:44.479076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:44.479563 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:44.480003 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:44.480700 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:44.481155 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:44.481580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:44.609797 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:44.618105 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-13a4910c-9a92-421d-a221-8881cf4e2559 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1266 microversion: 2.1 time: 0.151951 Aug 31 00:28:44.618683 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 571/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:44 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:44.809173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-c2c55cd5-d6d1-4e0e-818c-62a732155711 req-7fa5179c-af4b-45d5-bb54-efe402d2b240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344293b6-3291-4a4c-a440-8d8c97366cdb", "name": "network-vif-plugged", "status": "completed", "tag": "8cc27005-4124-4708-ac58-0eb4833c536e"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:44.818385 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-c2c55cd5-d6d1-4e0e-818c-62a732155711 req-7fa5179c-af4b-45d5-bb54-efe402d2b240 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:44.818859 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-c2c55cd5-d6d1-4e0e-818c-62a732155711 req-7fa5179c-af4b-45d5-bb54-efe402d2b240 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:44.819280 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-c2c55cd5-d6d1-4e0e-818c-62a732155711 req-7fa5179c-af4b-45d5-bb54-efe402d2b240 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:44.830408 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-c2c55cd5-d6d1-4e0e-818c-62a732155711 req-7fa5179c-af4b-45d5-bb54-efe402d2b240 service nova] Creating event network-vif-plugged:8cc27005-4124-4708-ac58-0eb4833c536e for instance 344293b6-3291-4a4c-a440-8d8c97366cdb on hv-cinder-85220 Aug 31 00:28:44.834955 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-c2c55cd5-d6d1-4e0e-818c-62a732155711 req-7fa5179c-af4b-45d5-bb54-efe402d2b240 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030253 Aug 31 00:28:44.835564 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 571/1142] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:44.838106 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:44.839549 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:44.846367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:44.846849 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:44.847286 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:44.847986 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:44.848440 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:44.848862 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:44.977613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:44.985175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9b1401aa-5835-4d76-b1b2-6aba50d07c10 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1313 microversion: 2.1 time: 0.156268 Aug 31 00:28:44.985899 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 572/1143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:44 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:45.639112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:45.639810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:45.645865 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:45.646381 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:45.646813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:45.647499 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:45.647949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:45.648374 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:45.782035 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:45.785625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=100 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:45.791491 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ad3426dc-fffd-4b43-911b-c7f44b46edac tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1452 microversion: 2.1 time: 0.156610 Aug 31 00:28:45.792054 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 572/1144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:45 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:45.811150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:45.811798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:45.818485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:45.818965 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:45.819396 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:45.820113 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:45.820559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:45.820977 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:45.953042 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:45.960789 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-a24ded99-d07b-45f5-ae5b-6e21cd63dc36 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1452 microversion: 2.1 time: 0.153476 Aug 31 00:28:45.961349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 573/1145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:45 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:46.005874 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:46.006593 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:46.013881 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:46.014445 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:46.014973 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:46.015731 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:46.016255 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:46.016798 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:46.177095 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:46.185243 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a8779c1d-3d66-4aea-9acd-1615ccff16db tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1313 microversion: 2.1 time: 0.183466 Aug 31 00:28:46.185803 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 573/1146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:46 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:47.207337 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:47.208116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:47.217199 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:47.218021 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:47.218495 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:47.219765 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:47.220446 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:47.220877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:47.451354 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:47.459078 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-701c70b7-4de4-468f-854c-c2901e335ceb tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1497 microversion: 2.1 time: 0.257222 Aug 31 00:28:47.459656 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 574/1147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:47 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:47.999245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-0047a130-0e16-42c4-8d6b-97432dd78f14 req-4b89349e-bb03-4f89-9366-fa9e1b1b0d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0258002a-8a09-4ef0-94de-a15ac1ea23aa", "tag": "8e99088b-8e89-4696-9dda-e1a593be3444"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:48.009247 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-0047a130-0e16-42c4-8d6b-97432dd78f14 req-4b89349e-bb03-4f89-9366-fa9e1b1b0d10 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:48.009722 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-0047a130-0e16-42c4-8d6b-97432dd78f14 req-4b89349e-bb03-4f89-9366-fa9e1b1b0d10 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:48.010182 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-0047a130-0e16-42c4-8d6b-97432dd78f14 req-4b89349e-bb03-4f89-9366-fa9e1b1b0d10 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:48.025477 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-0047a130-0e16-42c4-8d6b-97432dd78f14 req-4b89349e-bb03-4f89-9366-fa9e1b1b0d10 service nova] Creating event network-changed:8e99088b-8e89-4696-9dda-e1a593be3444 for instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa on hv-cinder-85220 Aug 31 00:28:48.032315 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-0047a130-0e16-42c4-8d6b-97432dd78f14 req-4b89349e-bb03-4f89-9366-fa9e1b1b0d10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035318 Aug 31 00:28:48.033089 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 574/1148] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:48.079726 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:48.080362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:48.088368 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:48.088872 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:48.089312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:48.090050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:48.090731 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:48.091153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:48.117676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:28:48.146273 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=100 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:48.207773 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2efd23d2-b213-4313-ba25-25a4650aaca2 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "DELETE /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 204 len: 0 microversion: 2.1 time: 0.131570 Aug 31 00:28:48.211774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 575/1149] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:28:48 2022] DELETE /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:28:48.219020 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:48.219712 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:48.226799 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:48.227329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:48.227954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:48.228836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:48.229638 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:48.230356 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:48.364666 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:48.372946 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-42e237aa-43f0-4595-87f0-510627db3c6d tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1503 microversion: 2.1 time: 0.159031 Aug 31 00:28:48.373507 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 575/1150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:48 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:49.395073 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:49.395771 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:49.402216 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:49.402696 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:49.403128 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:49.403808 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:49.404256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:49.404674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:49.537174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:49.545744 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-7c599cbe-543d-4416-9743-0baf7d3374a6 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1503 microversion: 2.1 time: 0.154949 Aug 31 00:28:49.546334 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 576/1151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:49 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:50.566620 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:50.567226 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:50.574289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:50.574766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:50.575197 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:50.575882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:50.576329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:50.576755 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:50.773396 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:50.781429 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-1a77d470-870e-4814-a16f-ca53747f31cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1503 microversion: 2.1 time: 0.218622 Aug 31 00:28:50.782211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 576/1152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:50 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:51.146941 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-09858143-bebd-49e0-ba67-47a1204ffadf req-c7c5ca2e-5090-487f-9a0b-4f4603eafcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344293b6-3291-4a4c-a440-8d8c97366cdb", "name": "network-vif-deleted", "tag": "8cc27005-4124-4708-ac58-0eb4833c536e"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:51.153368 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:51.159190 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-09858143-bebd-49e0-ba67-47a1204ffadf req-c7c5ca2e-5090-487f-9a0b-4f4603eafcf1 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:51.159673 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-09858143-bebd-49e0-ba67-47a1204ffadf req-c7c5ca2e-5090-487f-9a0b-4f4603eafcf1 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:51.160112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-09858143-bebd-49e0-ba67-47a1204ffadf req-c7c5ca2e-5090-487f-9a0b-4f4603eafcf1 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:51.174246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-09858143-bebd-49e0-ba67-47a1204ffadf req-c7c5ca2e-5090-487f-9a0b-4f4603eafcf1 service nova] Creating event network-vif-deleted:8cc27005-4124-4708-ac58-0eb4833c536e for instance 344293b6-3291-4a4c-a440-8d8c97366cdb on hv-cinder-85220 Aug 31 00:28:51.179514 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-09858143-bebd-49e0-ba67-47a1204ffadf req-c7c5ca2e-5090-487f-9a0b-4f4603eafcf1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036461 Aug 31 00:28:51.180105 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 577/1153] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:51.803516 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:51.804118 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:51.810580 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:51.811056 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:51.811482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:51.812160 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:51.812604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:51.813017 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:51.843273 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:51.843744 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:51.844170 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:51.844603 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lazy-loading 'fault' on Instance uuid 344293b6-3291-4a4c-a440-8d8c97366cdb {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:28:51.886898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:51.895093 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-acdd258d-457d-48b8-a615-2607c16cdb3f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 200 len: 1303 microversion: 2.1 time: 0.095403 Aug 31 00:28:51.895651 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 577/1154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:51 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:52.917985 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:52.918693 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 344293b6-3291-4a4c-a440-8d8c97366cdb] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:52.925123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:52.925610 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:52.926075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:52.926770 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:52.927224 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:52.927648 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:52.940805 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] HTTP exception thrown: Instance 344293b6-3291-4a4c-a440-8d8c97366cdb could not be found. Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Request method failure captured: Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb HTTP/1.1 Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqsv31Rthpba1FZGgdYgt6I_S1xK9lHgHiUVLOfHj0MW7nVMjalpCARp-i4Vp4pSYwvzDbK3dCK3iibs4jG3_Iiu_G0LO5UOhEYttlKvXq_y8Y7isgYHI1O7xt-JyWJ4NRqvM74PinJX-KL-FhCWM1ds05uchf5OY4BxqidHJvw1d1E Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: a1a6554fb0f242c18cd475cad255d5c5 Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-VolumesActionsTest-2140381346 Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:28:52.942442 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a1a6554fb0f242c18cd475cad255d5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a1a6554fb0f242c18cd475cad255d5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a1a6554fb0f242c18cd475cad255d5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a1a6554fb0f242c18cd475cad255d5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-VolumesActionsTest-2140381346 Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: a1a6554fb0f242c18cd475cad255d5c5 Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-VolumesActionsTest-2140381346 Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-VolumesActionsTest-2140381346-project Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 928feb4832ed4d42a765bdd393cbefa6 Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-VolumesActionsTest-2140381346-project Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 344293b6-3291-4a4c-a440-8d8c97366cdb could not be found. Aug 31 00:28:52.943929 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '344293b6-3291-4a4c-a440-8d8c97366cdb'} Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344293b6-3291-4a4c-a440-8d8c97366cdb could not be found. Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:52.945363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344293b6-3291-4a4c-a440-8d8c97366cdb could not be found. Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344293b6-3291-4a4c-a440-8d8c97366cdb could not be found. Aug 31 00:28:52.947214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:28:52.948742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Returning 404 to user: Instance 344293b6-3291-4a4c-a440-8d8c97366cdb could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:52.948742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6465d7f7-f9be-47f6-869c-03d2e068f638 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb" status: 404 len: 111 microversion: 2.1 time: 0.031156 Aug 31 00:28:52.948742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 578/1155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:52 2022] GET /compute/v2.1/servers/344293b6-3291-4a4c-a440-8d8c97366cdb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:52.992742 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1415531292", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "networks": [{"uuid": "ae2312b0-f506-47f8-8559-afa786d6ea94"}]}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:53.045246 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.network.neutron [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] validate_networks() for [('ae2312b0-f506-47f8-8559-afa786d6ea94', None, None, None, None, None)] {{(pid=132200) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:28:53.383639 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Flavor limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:28:53.383996 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Image limits 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:28:53.384462 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Flavor pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:28:53.384860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Image pref 0:0:0 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:28:53.385263 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.virt.hardware [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:28:53.393974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:53.394447 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:53.394872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:53.395585 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:53.396030 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:53.396443 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:53.413022 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Getting quotas for project a1a6554fb0f242c18cd475cad255d5c5. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:28:53.417195 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Getting quotas for user 928feb4832ed4d42a765bdd393cbefa6 and project a1a6554fb0f242c18cd475cad255d5c5. Resources: {'ram', 'instances', 'cores'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:28:53.428282 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Going to run 1 instances... {{(pid=132200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:28:53.431082 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:28:53.476011 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-69fe128f-a17f-4a2b-9cac-6c9fce3afa1f tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486884 Aug 31 00:28:53.476649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 578/1156] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:28:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:28:53.487212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-30a45d3d-82e4-42ac-8af0-d98d3c5e494e tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:53.487813 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-30a45d3d-82e4-42ac-8af0-d98d3c5e494e tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:53.544839 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-30a45d3d-82e4-42ac-8af0-d98d3c5e494e tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:53.551899 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-30a45d3d-82e4-42ac-8af0-d98d3c5e494e tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1214 microversion: 2.1 time: 0.068482 Aug 31 00:28:53.552485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 579/1157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:53 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:54.572731 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:54.573287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:54.575717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:54.581394 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:54.581882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:54.582313 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:54.582987 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:54.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:54.583851 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:54.647378 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:54.655068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-68379c93-4ff3-4532-92a1-cd0deff3fa15 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1266 microversion: 2.1 time: 0.086341 Aug 31 00:28:54.655629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 579/1158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:54 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:55.676495 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:55.677107 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:55.685148 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:55.685633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:55.686109 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:55.686815 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:55.687276 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:55.687705 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:55.821243 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:55.829156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-012b68ac-057f-47b1-8cbb-b46a8daa25de tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1314 microversion: 2.1 time: 0.156487 Aug 31 00:28:55.829726 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 580/1159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:55 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:56.208051 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-b3d6c0da-4cab-4734-b3c1-fbfca07de9c4 req-5da1cb1d-1ea8-4aa2-8ebb-7974e9c88e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66237e90-5854-4094-b5ce-dbaa84b68ac1", "tag": "5d591fa2-0558-4e88-969f-6cca1b87e515"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:56.219782 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-b3d6c0da-4cab-4734-b3c1-fbfca07de9c4 req-5da1cb1d-1ea8-4aa2-8ebb-7974e9c88e52 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:56.220346 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-b3d6c0da-4cab-4734-b3c1-fbfca07de9c4 req-5da1cb1d-1ea8-4aa2-8ebb-7974e9c88e52 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:56.220788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-b3d6c0da-4cab-4734-b3c1-fbfca07de9c4 req-5da1cb1d-1ea8-4aa2-8ebb-7974e9c88e52 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:56.237950 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-b3d6c0da-4cab-4734-b3c1-fbfca07de9c4 req-5da1cb1d-1ea8-4aa2-8ebb-7974e9c88e52 service nova] Creating event network-changed:5d591fa2-0558-4e88-969f-6cca1b87e515 for instance 66237e90-5854-4094-b5ce-dbaa84b68ac1 on hv-cinder-85220 Aug 31 00:28:56.244887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-b3d6c0da-4cab-4734-b3c1-fbfca07de9c4 req-5da1cb1d-1ea8-4aa2-8ebb-7974e9c88e52 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039711 Aug 31 00:28:56.246356 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 580/1160] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:56.849504 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:56.850151 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:56.857303 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:56.857794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:56.858294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:56.859026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:56.859485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:56.859915 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:56.984292 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:56.992524 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-02f8d199-da03-421b-9fc3-3a76619bdfdf tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1314 microversion: 2.1 time: 0.146992 Aug 31 00:28:56.993091 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 581/1161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:56 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:58.013756 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:58.014506 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:58.020992 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.021470 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.021925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.023105 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:58.023585 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:58.024006 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:58.231984 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:58.239773 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-e988f1d6-d484-41d0-8b97-9c69a53eb5cc tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1314 microversion: 2.1 time: 0.230799 Aug 31 00:28:58.240348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 581/1162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:58 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:59.260378 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:59.260992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:28:59.268020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:59.268500 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:59.269124 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:59.269822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:28:59.270301 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:28:59.270717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:28:59.406296 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:28:59.414918 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-615b4daa-6592-4d64-a833-4e2c8c99e466 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1314 microversion: 2.1 time: 0.158435 Aug 31 00:28:59.415491 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 582/1163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:28:59 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:00.435748 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:00.436357 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:00.442962 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:00.443436 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:00.443867 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:00.445052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:00.445499 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:00.445947 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:00.571265 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:00.578999 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-47343b9f-a1ae-4fe7-a385-dd732ba69384 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1314 microversion: 2.1 time: 0.147107 Aug 31 00:29:00.579566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 582/1164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:00 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:00.808610 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-58e78eba-d05e-46c3-b52c-ba6e01069c79 req-6185e2dc-2a04-433b-9ca1-96e8365166fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66237e90-5854-4094-b5ce-dbaa84b68ac1", "name": "network-vif-plugged", "status": "completed", "tag": "5d591fa2-0558-4e88-969f-6cca1b87e515"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:00.818634 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-58e78eba-d05e-46c3-b52c-ba6e01069c79 req-6185e2dc-2a04-433b-9ca1-96e8365166fd service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:00.819160 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-58e78eba-d05e-46c3-b52c-ba6e01069c79 req-6185e2dc-2a04-433b-9ca1-96e8365166fd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:00.820118 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-58e78eba-d05e-46c3-b52c-ba6e01069c79 req-6185e2dc-2a04-433b-9ca1-96e8365166fd service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:00.831404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-58e78eba-d05e-46c3-b52c-ba6e01069c79 req-6185e2dc-2a04-433b-9ca1-96e8365166fd service nova] Creating event network-vif-plugged:5d591fa2-0558-4e88-969f-6cca1b87e515 for instance 66237e90-5854-4094-b5ce-dbaa84b68ac1 on hv-cinder-85220 Aug 31 00:29:00.836814 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-58e78eba-d05e-46c3-b52c-ba6e01069c79 req-6185e2dc-2a04-433b-9ca1-96e8365166fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032775 Aug 31 00:29:00.837762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 583/1165] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:01.600193 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:01.601328 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:01.607932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:01.608403 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:01.608830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:01.609561 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:01.610083 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:01.610508 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:01.737766 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:01.745329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-43889af4-8ac8-407c-8b3a-e45f011548a0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1314 microversion: 2.1 time: 0.149023 Aug 31 00:29:01.745902 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 583/1166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:01 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:02.767054 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:02.767788 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:02.774545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:02.775030 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:02.775472 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:02.776162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:02.776617 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:02.777041 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:02.903238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:02.910974 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-d9569683-4922-454c-a6ad-e8bc7fb57590 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1498 microversion: 2.1 time: 0.148759 Aug 31 00:29:02.911542 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 584/1167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:02 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:03.595237 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:03.595859 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:03.598219 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:03.598892 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=6 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:03.604506 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:03.605015 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:03.605467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:03.606366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:03.606813 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:03.607228 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:03.632465 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:29:03.705232 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7fb2f341-7800-408f-891e-99e3bc78f1ff tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "DELETE /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 204 len: 0 microversion: 2.1 time: 0.113513 Aug 31 00:29:03.706057 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 584/1168] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:29:03 2022] DELETE /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:29:03.714994 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:03.715606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:03.717572 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:03.722852 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:03.723344 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:03.723774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:03.724456 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:03.724907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:03.725379 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:03.861223 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:03.869127 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4cc31588-1ef7-44cf-8fc7-fb5a53f533f0 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1504 microversion: 2.1 time: 0.158101 Aug 31 00:29:03.869685 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 585/1169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:03 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:04.890771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:04.891467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:04.902000 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:04.902481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:04.902913 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:04.903596 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:04.904047 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:04.904468 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:05.033706 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:05.042623 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7fdcaac0-3c72-47d1-844b-078b63fad807 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1504 microversion: 2.1 time: 0.156154 Aug 31 00:29:05.043363 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 585/1170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:04 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:06.064282 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:06.064870 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:06.071864 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:06.072344 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:06.072778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:06.073467 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:06.073948 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:06.074372 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:06.199570 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:06.207230 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-295d184b-44ab-47e9-ba68-cd64e9d9133c tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1504 microversion: 2.1 time: 0.146807 Aug 31 00:29:06.207795 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 586/1171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:06 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:06.695558 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-b7a23fa1-1007-4e11-a616-4bf2f84d5c22 req-5a44d4e8-b379-476a-960a-3c872b0ca7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66237e90-5854-4094-b5ce-dbaa84b68ac1", "name": "network-vif-deleted", "tag": "5d591fa2-0558-4e88-969f-6cca1b87e515"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:06.705896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-b7a23fa1-1007-4e11-a616-4bf2f84d5c22 req-5a44d4e8-b379-476a-960a-3c872b0ca7d4 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:06.706466 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-b7a23fa1-1007-4e11-a616-4bf2f84d5c22 req-5a44d4e8-b379-476a-960a-3c872b0ca7d4 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:06.706898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-b7a23fa1-1007-4e11-a616-4bf2f84d5c22 req-5a44d4e8-b379-476a-960a-3c872b0ca7d4 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:06.718199 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-b7a23fa1-1007-4e11-a616-4bf2f84d5c22 req-5a44d4e8-b379-476a-960a-3c872b0ca7d4 service nova] Creating event network-vif-deleted:5d591fa2-0558-4e88-969f-6cca1b87e515 for instance 66237e90-5854-4094-b5ce-dbaa84b68ac1 on hv-cinder-85220 Aug 31 00:29:06.722870 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-b7a23fa1-1007-4e11-a616-4bf2f84d5c22 req-5a44d4e8-b379-476a-960a-3c872b0ca7d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031681 Aug 31 00:29:06.723384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 586/1172] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:07.228109 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:07.228717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:07.234725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.235199 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.235630 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.236311 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.236763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.237187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.266959 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:07.267424 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:07.267852 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:07.268291 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lazy-loading 'fault' on Instance uuid 66237e90-5854-4094-b5ce-dbaa84b68ac1 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:29:07.307980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '928feb4832ed4d42a765bdd393cbefa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a6554fb0f242c18cd475cad255d5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:07.315596 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-63c54c78-8fe0-4ab6-b930-18dfa3be4c74 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 200 len: 1304 microversion: 2.1 time: 0.091509 Aug 31 00:29:07.316161 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 587/1173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:07 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:08.338082 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:08.338788 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] [instance: 66237e90-5854-4094-b5ce-dbaa84b68ac1] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:08.345073 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:08.345554 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:08.346019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:08.346709 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:08.347162 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:08.347585 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:08.360704 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] HTTP exception thrown: Instance 66237e90-5854-4094-b5ce-dbaa84b68ac1 could not be found. Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Request method failure captured: Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 HTTP/1.1 Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqsv31Rthpba1FZGgdYgt6I_S1xK9lHgHiUVLOfHj0MW7nVMjalpCARp-i4Vp4pSYwvzDbK3dCK3iibs4jG3_Iiu_G0LO5UOhEYttlKvXq_y8Y7isgYHI1O7xt-JyWJ4NRqvM74PinJX-KL-FhCWM1ds05uchf5OY4BxqidHJvw1d1E Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: a1a6554fb0f242c18cd475cad255d5c5 Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-VolumesActionsTest-2140381346 Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:29:08.362339 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a1a6554fb0f242c18cd475cad255d5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a1a6554fb0f242c18cd475cad255d5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a1a6554fb0f242c18cd475cad255d5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a1a6554fb0f242c18cd475cad255d5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-VolumesActionsTest-2140381346 Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: a1a6554fb0f242c18cd475cad255d5c5 Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-VolumesActionsTest-2140381346 Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-VolumesActionsTest-2140381346-project Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 928feb4832ed4d42a765bdd393cbefa6 Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-VolumesActionsTest-2140381346-project Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 66237e90-5854-4094-b5ce-dbaa84b68ac1 could not be found. Aug 31 00:29:08.364078 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '66237e90-5854-4094-b5ce-dbaa84b68ac1'} Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66237e90-5854-4094-b5ce-dbaa84b68ac1 could not be found. Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:08.365212 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66237e90-5854-4094-b5ce-dbaa84b68ac1 could not be found. Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66237e90-5854-4094-b5ce-dbaa84b68ac1 could not be found. Aug 31 00:29:08.367440 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:08.369032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] Returning 404 to user: Instance 66237e90-5854-4094-b5ce-dbaa84b68ac1 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:08.369032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-46f32c40-9018-4e26-85b3-2ee4274929c7 tempest-VolumesActionsTest-2140381346 tempest-VolumesActionsTest-2140381346-project] 10.222.0.49 "GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1" status: 404 len: 111 microversion: 2.1 time: 0.030597 Aug 31 00:29:08.369032 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 587/1174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:08 2022] GET /compute/v2.1/servers/66237e90-5854-4094-b5ce-dbaa84b68ac1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:33.767136 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-815ff9e8-dead-4291-a57e-4e98b565051a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:33.767845 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-815ff9e8-dead-4291-a57e-4e98b565051a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:33.770737 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=25 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:33.771559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:33.777527 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-815ff9e8-dead-4291-a57e-4e98b565051a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:33.778051 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-815ff9e8-dead-4291-a57e-4e98b565051a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:33.778490 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-815ff9e8-dead-4291-a57e-4e98b565051a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:33.779194 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-815ff9e8-dead-4291-a57e-4e98b565051a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:33.779648 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-815ff9e8-dead-4291-a57e-4e98b565051a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:33.780074 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-815ff9e8-dead-4291-a57e-4e98b565051a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:33.806159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-815ff9e8-dead-4291-a57e-4e98b565051a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/ips" status: 200 len: 149 microversion: 2.1 time: 0.042825 Aug 31 00:29:33.806727 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 588/1175] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:29:33 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:29:35.129490 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-387647ce-e699-464b-b06b-51db76738690 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b57d915-19e2-4305-9cd2-c1a577c41a66"}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:35.131763 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-387647ce-e699-464b-b06b-51db76738690 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:35.134228 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:35.134882 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:35.141094 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387647ce-e699-464b-b06b-51db76738690 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:35.141553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387647ce-e699-464b-b06b-51db76738690 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:35.142015 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387647ce-e699-464b-b06b-51db76738690 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:35.142705 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387647ce-e699-464b-b06b-51db76738690 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:35.143156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387647ce-e699-464b-b06b-51db76738690 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:35.143578 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-387647ce-e699-464b-b06b-51db76738690 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:35.610202 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-387647ce-e699-464b-b06b-51db76738690 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484651 Aug 31 00:29:35.610802 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 588/1176] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:29:35 2022] POST /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:43.299903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b57d915-19e2-4305-9cd2-c1a577c41a66"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:43.302308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:43.308501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:43.308980 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:43.309415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:43.310151 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:43.310602 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:43.311050 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:43.442854 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Invalid volume: volume 3b57d915-19e2-4305-9cd2-c1a577c41a66 is already attached to instances: 1f6c5476-e889-42b0-a0e9-abd3044c4031 Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: POST /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments HTTP/1.1 Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 74 Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:29:43.444552 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {"volumeAttachment": {"volumeId": "3b57d915-19e2-4305-9cd2-c1a577c41a66"}} Aug 31 00:29:43.446346 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Invalid volume: volume 3b57d915-19e2-4305-9cd2-c1a577c41a66 is already attached to instances: 1f6c5476-e889-42b0-a0e9-abd3044c4031 Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'server_id': '1f6c5476-e889-42b0-a0e9-abd3044c4031', 'body': {'volumeAttachment': {'volumeId': '3b57d915-19e2-4305-9cd2-c1a577c41a66'}}} Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3b57d915-19e2-4305-9cd2-c1a577c41a66 is already attached to instances: 1f6c5476-e889-42b0-a0e9-abd3044c4031 Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:29:43.447341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3b57d915-19e2-4305-9cd2-c1a577c41a66 is already attached to instances: 1f6c5476-e889-42b0-a0e9-abd3044c4031 Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:43.448885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:43.450537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:43.450537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:43.450537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:43.450537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3b57d915-19e2-4305-9cd2-c1a577c41a66 is already attached to instances: 1f6c5476-e889-42b0-a0e9-abd3044c4031 Aug 31 00:29:43.450537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:29:43.450537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 400 to user: Invalid volume: volume 3b57d915-19e2-4305-9cd2-c1a577c41a66 is already attached to instances: 1f6c5476-e889-42b0-a0e9-abd3044c4031 {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:43.450537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-e1af68d6-3aa4-428a-9845-e56b0462ebb0 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.150408 Aug 31 00:29:43.450537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 589/1177] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:29:43 2022] POST /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:29:43.511348 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:43.511921 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:43.519009 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:43.519430 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:43.519865 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:43.521232 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:43.521706 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:43.522171 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:43.602192 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.objects.instance [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lazy-loading 'services' on Instance uuid 1f6c5476-e889-42b0-a0e9-abd3044c4031 {{(pid=132200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:29:43.671836 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4194542f-855b-478e-9b58-fdd21cfed3fc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments/3b57d915-19e2-4305-9cd2-c1a577c41a66" status: 202 len: 0 microversion: 2.1 time: 0.165364 Aug 31 00:29:43.672418 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 589/1178] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:29:43 2022] DELETE /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments/3b57d915-19e2-4305-9cd2-c1a577c41a66 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:29:43.680861 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b12a4580-d62b-42ac-a9d2-83214164fa4f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:43.683112 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b12a4580-d62b-42ac-a9d2-83214164fa4f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:43.689268 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b12a4580-d62b-42ac-a9d2-83214164fa4f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:43.689884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b12a4580-d62b-42ac-a9d2-83214164fa4f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:43.690431 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b12a4580-d62b-42ac-a9d2-83214164fa4f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:43.691133 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b12a4580-d62b-42ac-a9d2-83214164fa4f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:43.691690 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b12a4580-d62b-42ac-a9d2-83214164fa4f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:43.692698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b12a4580-d62b-42ac-a9d2-83214164fa4f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:43.724806 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b12a4580-d62b-42ac-a9d2-83214164fa4f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047896 Aug 31 00:29:43.725367 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 590/1179] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:29:43 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:44.737260 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-90f0d667-e601-422e-8a11-032248c8ad93 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:44.739649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-90f0d667-e601-422e-8a11-032248c8ad93 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:44.746400 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90f0d667-e601-422e-8a11-032248c8ad93 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:44.746820 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90f0d667-e601-422e-8a11-032248c8ad93 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:44.747254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90f0d667-e601-422e-8a11-032248c8ad93 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:44.748049 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90f0d667-e601-422e-8a11-032248c8ad93 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:44.748501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90f0d667-e601-422e-8a11-032248c8ad93 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:44.748925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-90f0d667-e601-422e-8a11-032248c8ad93 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:44.779733 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-90f0d667-e601-422e-8a11-032248c8ad93 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046790 Aug 31 00:29:44.780283 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 590/1180] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:29:44 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:29:44.841426 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:44.841955 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:44.848490 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:44.848972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:44.849408 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:44.850123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:44.850573 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:44.850998 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:44.876774 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Going to try to terminate instance {{(pid=132201) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:29:44.960309 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-374a94a1-11fc-4b3f-b3ec-8abf2de96020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 204 len: 0 microversion: 2.1 time: 0.122509 Aug 31 00:29:44.960896 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 591/1181] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:29:44 2022] DELETE /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:29:44.969416 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:44.970024 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:44.976634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:44.977119 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:44.977558 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:44.978293 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:44.978772 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:44.979195 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:45.344727 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:45.352482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5ad1f97b-e51e-419f-92ec-988787ea686f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1679 microversion: 2.1 time: 0.387426 Aug 31 00:29:45.353046 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 591/1182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:44 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1679 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:46.373007 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:46.373704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:46.380683 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:46.381159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:46.381586 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:46.382291 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:46.382733 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:46.383150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:46.516496 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:46.524963 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5dae019d-a972-49ab-a0fc-80b420220caf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1679 microversion: 2.1 time: 0.156183 Aug 31 00:29:46.525533 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 592/1183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:46 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:47.546900 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:47.547629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:47.554185 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:47.554663 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:47.555086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:47.555771 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:47.556213 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:47.556625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:47.648769 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:47.658759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a54119d8-3f97-4f3d-96d3-a4ffbcfd157e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 200 len: 1612 microversion: 2.1 time: 0.115413 Aug 31 00:29:47.659259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 592/1184] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:47 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 1612 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:29:47.741710 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-8938b76c-94c3-4fde-9032-2a46e43e2346 req-191b9bc1-11f7-4713-83ca-2cb6818e6bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6c5476-e889-42b0-a0e9-abd3044c4031", "name": "network-vif-deleted", "tag": "14fe4cc5-6472-4715-a6a8-33e8cb4f97c6"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:47.755715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8938b76c-94c3-4fde-9032-2a46e43e2346 req-191b9bc1-11f7-4713-83ca-2cb6818e6bec service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:47.757076 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8938b76c-94c3-4fde-9032-2a46e43e2346 req-191b9bc1-11f7-4713-83ca-2cb6818e6bec service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:47.757754 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8938b76c-94c3-4fde-9032-2a46e43e2346 req-191b9bc1-11f7-4713-83ca-2cb6818e6bec service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:47.774096 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-8938b76c-94c3-4fde-9032-2a46e43e2346 req-191b9bc1-11f7-4713-83ca-2cb6818e6bec service nova] Creating event network-vif-deleted:14fe4cc5-6472-4715-a6a8-33e8cb4f97c6 for instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 on hv-cinder-85220 Aug 31 00:29:47.779176 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-8938b76c-94c3-4fde-9032-2a46e43e2346 req-191b9bc1-11f7-4713-83ca-2cb6818e6bec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131638 Aug 31 00:29:47.780084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 593/1185] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:48.682227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:48.682940 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:48.691114 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:48.691605 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:48.695650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:48.695650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:48.695650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:48.695650 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:48.711707 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 HTTP/1.1 Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:29:48.713393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:29:48.715157 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '1f6c5476-e889-42b0-a0e9-abd3044c4031'} Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:29:48.716063 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:29:48.717739 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:29:48.719284 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:29:48.719284 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-365eb96c-97ee-4f0b-bf12-38a6a6489682 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 404 len: 111 microversion: 2.1 time: 0.038170 Aug 31 00:29:48.719284 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 593/1186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:48 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:48.725678 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ac1e414e-b0a1-4020-9634-ef5a40704e29 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '.version_select at 0x7fcd736303a0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:48.746624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ac1e414e-b0a1-4020-9634-ef5a40704e29 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298416312" status: 202 len: 0 microversion: 2.1 time: 0.025825 Aug 31 00:29:48.747362 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 594/1187] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 31 00:29:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298416312 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:29:49.356179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-868e43b5-c122-4b13-8db4-e56d1e2c8282 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: .version_select at 0x7fcd70224f70>, body: {"keypair": {"name": "tempest-keypair-807847025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvxGnWtz/NV4r6RSLkwTLG6PeiICMRGwUpc1JA9qMY6KbPL5E2BE316ahaytRR5Um1apeoG580kPzGVlFI/WjvKTfbgclWFlQJ4z2Uz2N2Y8UGSXoL5Q+n58JFMMKdViA=="}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:49.371394 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-868e43b5-c122-4b13-8db4-e56d1e2c8282 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:29:49.375231 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.quota [None req-868e43b5-c122-4b13-8db4-e56d1e2c8282 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for user 988168279e8e495a985e209a35764f2b and project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'key_pairs'} {{(pid=132200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:29:49.397179 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-868e43b5-c122-4b13-8db4-e56d1e2c8282 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044865 Aug 31 00:29:49.397757 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 594/1188] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 31 00:29:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:50.651066 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1514617797", "imageRef": "17f880b9-11b9-4a6f-8ea4-649250a9fc29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c68b95b5-2004-4926-97ca-43c398029473"}], "security_groups": [{"name": "tempest-securitygroup--1612590440"}], "key_name": "tempest-keypair-807847025", "user_data": "}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:50.753286 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.network.neutron [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] validate_networks() for [('c68b95b5-2004-4926-97ca-43c398029473', None, None, None, None, None)] {{(pid=132201) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:29:51.130632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Flavor limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:29:51.131058 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Image limits 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:29:51.131532 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Flavor pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:29:51.131939 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Image pref 0:0:0 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:29:51.132349 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.virt.hardware [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:29:51.141121 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:51.141598 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:51.142065 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:51.142794 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:51.143245 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:51.143672 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:51.161174 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:29:51.165387 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.quota [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Getting quotas for user 988168279e8e495a985e209a35764f2b and project 8f133f3096eb472d9a3c98ea9b81c1b9. Resources: {'ram', 'instances', 'cores'} {{(pid=132201) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:29:51.176269 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Going to run 1 instances... {{(pid=132201) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:29:51.178643 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f880b9-11b9-4a6f-8ea4-649250a9fc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132201) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:29:51.225150 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8a549552-9740-4eab-8d26-6b56e7cc5728 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.578423 Aug 31 00:29:51.225982 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 595/1189] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 31 00:29:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:29:51.237110 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ba5fa5d8-b61d-4134-a33c-af7f18202256 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:51.237770 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ba5fa5d8-b61d-4134-a33c-af7f18202256 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:51.294954 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-ba5fa5d8-b61d-4134-a33c-af7f18202256 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:51.301816 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ba5fa5d8-b61d-4134-a33c-af7f18202256 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1241 microversion: 2.1 time: 0.069068 Aug 31 00:29:51.302422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 595/1190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:51 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:52.324122 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:52.324830 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:52.332607 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:52.333123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:52.333551 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:52.334270 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:52.334720 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:52.335141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:52.398395 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:52.406673 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2252ac28-4acc-4680-8cb1-642e01e3ec59 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1293 microversion: 2.1 time: 0.087435 Aug 31 00:29:52.407255 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 596/1191] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:52 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:53.428627 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:53.429393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:53.436150 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:53.436789 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:53.437326 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:53.438299 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:53.438856 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:53.439403 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:53.701347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:53.709022 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-448dde46-c0ba-4c68-affd-93797301797e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1367 microversion: 2.1 time: 0.285025 Aug 31 00:29:53.709594 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 596/1192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:53 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:54.037967 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-40c66597-a398-4f61-b202-fde7e2079741 req-e4afa733-8500-4fd2-a787-9445257720c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c327dc31-7116-4b2e-8192-eccf9af816f3", "tag": "8c370e03-5387-4716-9387-3ac86e319959"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:54.048253 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-40c66597-a398-4f61-b202-fde7e2079741 req-e4afa733-8500-4fd2-a787-9445257720c2 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:54.048823 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-40c66597-a398-4f61-b202-fde7e2079741 req-e4afa733-8500-4fd2-a787-9445257720c2 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:54.049334 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-40c66597-a398-4f61-b202-fde7e2079741 req-e4afa733-8500-4fd2-a787-9445257720c2 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:54.060612 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-40c66597-a398-4f61-b202-fde7e2079741 req-e4afa733-8500-4fd2-a787-9445257720c2 service nova] Creating event network-changed:8c370e03-5387-4716-9387-3ac86e319959 for instance c327dc31-7116-4b2e-8192-eccf9af816f3 on hv-cinder-85220 Aug 31 00:29:54.065492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-40c66597-a398-4f61-b202-fde7e2079741 req-e4afa733-8500-4fd2-a787-9445257720c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032174 Aug 31 00:29:54.066698 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 597/1193] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:54.732083 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:54.732719 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:54.739183 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:54.739665 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:54.740104 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:54.740787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:54.741295 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:54.741673 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:54.875053 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:54.883347 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-da8c1696-ec2c-4afb-8814-976f5c6abb3e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1367 microversion: 2.1 time: 0.155187 Aug 31 00:29:54.883909 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 597/1194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:54 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:55.905715 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:55.906448 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:55.913668 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:55.914182 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:55.914626 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:55.915341 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:55.915880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:55.916310 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:56.053884 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:56.061562 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-99ac324a-6fd0-4cf1-b8c5-a62841c39bb3 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1367 microversion: 2.1 time: 0.160843 Aug 31 00:29:56.062152 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 598/1195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:55 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:57.083400 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:57.084153 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:57.090888 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.091366 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.091815 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:57.092497 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:57.092950 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:57.093375 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:57.224432 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:57.232299 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-8e2b7f56-7ba3-425f-9a90-78c5cbcf5aba tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1367 microversion: 2.1 time: 0.153344 Aug 31 00:29:57.232870 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 598/1196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:57 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:58.254665 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:58.255268 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:58.261749 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:58.262256 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:58.262687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:58.263368 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:58.263809 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:58.264227 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:58.390872 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:58.398514 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ea9b9875-76b0-4886-90a1-ae714d7648bc tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1367 microversion: 2.1 time: 0.148362 Aug 31 00:29:58.399070 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 599/1197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:58 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:59.145393 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-f6f723fc-ead0-429e-9e3c-fdb9b548bc0b req-1a3c95c9-9702-406f-9aff-d0ec1c7eb407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c327dc31-7116-4b2e-8192-eccf9af816f3", "name": "network-vif-plugged", "status": "completed", "tag": "8c370e03-5387-4716-9387-3ac86e319959"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:29:59.154993 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-f6f723fc-ead0-429e-9e3c-fdb9b548bc0b req-1a3c95c9-9702-406f-9aff-d0ec1c7eb407 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:59.155467 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-f6f723fc-ead0-429e-9e3c-fdb9b548bc0b req-1a3c95c9-9702-406f-9aff-d0ec1c7eb407 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:59.155887 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-f6f723fc-ead0-429e-9e3c-fdb9b548bc0b req-1a3c95c9-9702-406f-9aff-d0ec1c7eb407 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:59.169146 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-f6f723fc-ead0-429e-9e3c-fdb9b548bc0b req-1a3c95c9-9702-406f-9aff-d0ec1c7eb407 service nova] Creating event network-vif-plugged:8c370e03-5387-4716-9387-3ac86e319959 for instance c327dc31-7116-4b2e-8192-eccf9af816f3 on hv-cinder-85220 Aug 31 00:29:59.174488 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-f6f723fc-ead0-429e-9e3c-fdb9b548bc0b req-1a3c95c9-9702-406f-9aff-d0ec1c7eb407 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095769 Aug 31 00:29:59.175070 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 599/1198] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:59.419238 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:59.419853 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:59.427415 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:59.427905 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:59.428339 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:59.429209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:29:59.429875 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:29:59.430598 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:29:59.892274 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:29:59.899968 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-caa8503c-b8a3-41b1-a422-fc6505174bc2 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1367 microversion: 2.1 time: 0.484656 Aug 31 00:29:59.900541 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 600/1199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:29:59 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1367 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:59.992861 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:59.993717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:29:59.996225 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-8abbc77d-9ad8-49b9-b51c-2b921c2b6642 req-3e4bec83-3e89-4c68-a748-6ec2cc507456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6598868f-94b6-4429-90ba-8ccf12c92c6c", "tag": "f6ac30ae-f9d0-46c7-b217-0d25aa55a23b"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:00.000455 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:00.001255 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:00.001965 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:00.002872 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:00.003525 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:00.004566 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:00.006842 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8abbc77d-9ad8-49b9-b51c-2b921c2b6642 req-3e4bec83-3e89-4c68-a748-6ec2cc507456 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:00.007312 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8abbc77d-9ad8-49b9-b51c-2b921c2b6642 req-3e4bec83-3e89-4c68-a748-6ec2cc507456 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:00.007933 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8abbc77d-9ad8-49b9-b51c-2b921c2b6642 req-3e4bec83-3e89-4c68-a748-6ec2cc507456 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:00.019070 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-8abbc77d-9ad8-49b9-b51c-2b921c2b6642 req-3e4bec83-3e89-4c68-a748-6ec2cc507456 service nova] Creating event network-changed:f6ac30ae-f9d0-46c7-b217-0d25aa55a23b for instance 6598868f-94b6-4429-90ba-8ccf12c92c6c on hv-cinder-85220 Aug 31 00:30:00.024447 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-8abbc77d-9ad8-49b9-b51c-2b921c2b6642 req-3e4bec83-3e89-4c68-a748-6ec2cc507456 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033905 Aug 31 00:30:00.025473 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 601/1200] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:00.032837 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:30:00.114245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-72b124f0-df61-48a7-8cfc-fb0c0f6c2571 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 204 len: 0 microversion: 2.1 time: 0.125345 Aug 31 00:30:00.114844 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 600/1201] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:29:59 2022] DELETE /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:30:00.125831 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:00.127090 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:00.132907 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:00.133385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:00.133828 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:00.134547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:00.134997 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:00.135416 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:00.269452 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:00.277560 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b96f50d6-b892-4c5b-bd5f-f94dcc4f8d1e tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.157749 Aug 31 00:30:00.278092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 602/1202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:00 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:00.921203 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:00.922117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:00.927918 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:00.928394 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:00.928826 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:00.929501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:00.929974 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:00.930390 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:01.062244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:01.070450 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4ba202fa-371f-4388-893d-a446553fb2a6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1367 microversion: 2.1 time: 0.153465 Aug 31 00:30:01.071017 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 601/1203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:00 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:01.303166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:01.304109 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell0:SELECT=6 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:01.405736 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:01.405736 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:01.411645 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:01.412589 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:01.413207 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:01.414104 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:01.414733 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:01.415156 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:01.559445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:01.567841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-b498935e-391d-4cdb-ae65-c8e63e7cab6f tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.270321 Aug 31 00:30:01.568485 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 603/1204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:01 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:02.091631 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:02.092245 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:02.094672 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell0:SELECT=6 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:02.100040 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.100522 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.100966 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.101657 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.102135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.102562 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.299625 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:02.308236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d09f463f-a8cf-48ce-8897-717e12520cb9 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1557 microversion: 2.1 time: 0.220489 Aug 31 00:30:02.311007 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 602/1205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:02 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1557 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:02.332842 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ce4c54e8-75fd-481a-a88c-afd8c4459a87 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:02.333427 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ce4c54e8-75fd-481a-a88c-afd8c4459a87 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:02.341173 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ce4c54e8-75fd-481a-a88c-afd8c4459a87 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.341745 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ce4c54e8-75fd-481a-a88c-afd8c4459a87 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.342215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ce4c54e8-75fd-481a-a88c-afd8c4459a87 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.343085 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ce4c54e8-75fd-481a-a88c-afd8c4459a87 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.343542 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ce4c54e8-75fd-481a-a88c-afd8c4459a87 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.343972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ce4c54e8-75fd-481a-a88c-afd8c4459a87 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.451817 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ce4c54e8-75fd-481a-a88c-afd8c4459a87 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123059 Aug 31 00:30:02.452525 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 604/1206] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 31 00:30:02 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:02.588756 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:02.589372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:02.595341 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.595826 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.596293 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.596990 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.598001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.598433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.769108 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-997b0356-fb6b-401e-8d2f-a91aa9fd7dc8 req-b2c0179f-5ed1-43b9-a1fb-29f6fb189712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6598868f-94b6-4429-90ba-8ccf12c92c6c", "name": "network-vif-deleted", "tag": "f6ac30ae-f9d0-46c7-b217-0d25aa55a23b"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:02.782683 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-997b0356-fb6b-401e-8d2f-a91aa9fd7dc8 req-b2c0179f-5ed1-43b9-a1fb-29f6fb189712 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:02.783100 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-997b0356-fb6b-401e-8d2f-a91aa9fd7dc8 req-b2c0179f-5ed1-43b9-a1fb-29f6fb189712 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:02.783537 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-997b0356-fb6b-401e-8d2f-a91aa9fd7dc8 req-b2c0179f-5ed1-43b9-a1fb-29f6fb189712 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:02.796400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-997b0356-fb6b-401e-8d2f-a91aa9fd7dc8 req-b2c0179f-5ed1-43b9-a1fb-29f6fb189712 service nova] Creating event network-vif-deleted:f6ac30ae-f9d0-46c7-b217-0d25aa55a23b for instance 6598868f-94b6-4429-90ba-8ccf12c92c6c on hv-cinder-85220 Aug 31 00:30:02.802022 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-997b0356-fb6b-401e-8d2f-a91aa9fd7dc8 req-b2c0179f-5ed1-43b9-a1fb-29f6fb189712 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036514 Aug 31 00:30:02.802622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 605/1207] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:03.180600 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046c0674004e4747b4a365f26a5b8f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:03.196955 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4d5a3b7d-3bbc-4681-8b39-2d21bec76fcc tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 200 len: 1569 microversion: 2.1 time: 0.611872 Aug 31 00:30:03.198127 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 603/1208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:02 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 1569 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:03.898778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-b84baac6-1d33-4132-afb9-17c3aa17f14c req-1414af66-182d-4cb6-8aaf-8fc413855af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c327dc31-7116-4b2e-8192-eccf9af816f3", "tag": "8c370e03-5387-4716-9387-3ac86e319959"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:03.903837 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:03.910885 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-b84baac6-1d33-4132-afb9-17c3aa17f14c req-1414af66-182d-4cb6-8aaf-8fc413855af8 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:03.911369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-b84baac6-1d33-4132-afb9-17c3aa17f14c req-1414af66-182d-4cb6-8aaf-8fc413855af8 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:03.911802 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-b84baac6-1d33-4132-afb9-17c3aa17f14c req-1414af66-182d-4cb6-8aaf-8fc413855af8 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:03.916577 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:03.924977 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-b84baac6-1d33-4132-afb9-17c3aa17f14c req-1414af66-182d-4cb6-8aaf-8fc413855af8 service nova] Creating event network-changed:8c370e03-5387-4716-9387-3ac86e319959 for instance c327dc31-7116-4b2e-8192-eccf9af816f3 on hv-cinder-85220 Aug 31 00:30:03.930369 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-b84baac6-1d33-4132-afb9-17c3aa17f14c req-1414af66-182d-4cb6-8aaf-8fc413855af8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036449 Aug 31 00:30:03.931246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 606/1209] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:04.220482 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:04.221072 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] [instance: 6598868f-94b6-4429-90ba-8ccf12c92c6c] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:04.227542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:04.228017 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:04.228443 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:04.229128 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:04.229760 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:04.230403 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:04.234674 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:04.246093 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] HTTP exception thrown: Instance 6598868f-94b6-4429-90ba-8ccf12c92c6c could not be found. Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Request method failure captured: Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c HTTP/1.1 Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqpV37rEhz6zKNcxctaf3f6rBht4FuDxN6FCfT6BSyhpJBqRtUjjJPXec-wa3Z3s2gCkPd9eAYofD0tAZBMjknYFFDzaHzwLYtatTzhGOUxuXXGOU2z7baoxZjjUZpagJzhuiHmgcDYagJsv9-uLBRH3KXwvcXfAlngsotUpiBvC3uU Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: bb6e5312ca7c4188b95dcab2a6edc7c6 Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-TestShelveInstance-81899712 Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:30:04.247831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bb6e5312ca7c4188b95dcab2a6edc7c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bb6e5312ca7c4188b95dcab2a6edc7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bb6e5312ca7c4188b95dcab2a6edc7c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bb6e5312ca7c4188b95dcab2a6edc7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-TestShelveInstance-81899712 Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: bb6e5312ca7c4188b95dcab2a6edc7c6 Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-TestShelveInstance-81899712 Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-TestShelveInstance-81899712-project Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 046c0674004e4747b4a365f26a5b8f5c Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-TestShelveInstance-81899712-project Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 6598868f-94b6-4429-90ba-8ccf12c92c6c could not be found. Aug 31 00:30:04.249758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '6598868f-94b6-4429-90ba-8ccf12c92c6c'} Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6598868f-94b6-4429-90ba-8ccf12c92c6c could not be found. Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:04.250810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6598868f-94b6-4429-90ba-8ccf12c92c6c could not be found. Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6598868f-94b6-4429-90ba-8ccf12c92c6c could not be found. Aug 31 00:30:04.252207 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:04.255949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Returning 404 to user: Instance 6598868f-94b6-4429-90ba-8ccf12c92c6c could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:04.255949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-ce01655c-176a-466b-9e12-036d4e3a4c43 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c" status: 404 len: 111 microversion: 2.1 time: 0.032566 Aug 31 00:30:04.255949 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 604/1210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:04 2022] GET /compute/v2.1/servers/6598868f-94b6-4429-90ba-8ccf12c92c6c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:04.432948 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-bb15ee93-8f51-40ea-916f-dd8eff4a23c8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] Calling method '.version_select at 0x7fcd73645040>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:04.468209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-bb15ee93-8f51-40ea-916f-dd8eff4a23c8 tempest-TestShelveInstance-81899712 tempest-TestShelveInstance-81899712-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1059407937" status: 202 len: 0 microversion: 2.1 time: 0.039052 Aug 31 00:30:04.469376 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 607/1211] 10.222.0.49 () {58 vars in 1254 bytes} [Wed Aug 31 00:30:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1059407937 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:30:28.907553 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:28.908166 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:28.908976 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:28.909119 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:28.912294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:28.914825 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-771bdd18-f6aa-4061-b16d-4f42bfd8f761 req-4a59ca46-1b75-49a4-a7e2-943ebe1d9981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0258002a-8a09-4ef0-94de-a15ac1ea23aa", "tag": "8e99088b-8e89-4696-9dda-e1a593be3444"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:28.920107 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:28.920787 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:28.921236 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:28.922422 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:28.922891 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:28.923329 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:28.927742 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-771bdd18-f6aa-4061-b16d-4f42bfd8f761 req-4a59ca46-1b75-49a4-a7e2-943ebe1d9981 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:28.928216 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-771bdd18-f6aa-4061-b16d-4f42bfd8f761 req-4a59ca46-1b75-49a4-a7e2-943ebe1d9981 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:28.928645 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-771bdd18-f6aa-4061-b16d-4f42bfd8f761 req-4a59ca46-1b75-49a4-a7e2-943ebe1d9981 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:28.940460 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-771bdd18-f6aa-4061-b16d-4f42bfd8f761 req-4a59ca46-1b75-49a4-a7e2-943ebe1d9981 service nova] Creating event network-changed:8e99088b-8e89-4696-9dda-e1a593be3444 for instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa on hv-cinder-85220 Aug 31 00:30:28.945877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-771bdd18-f6aa-4061-b16d-4f42bfd8f761 req-4a59ca46-1b75-49a4-a7e2-943ebe1d9981 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039680 Aug 31 00:30:28.946740 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 608/1212] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:28.952725 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:30:29.046629 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-96371398-a65c-402e-9c6f-1124cf393574 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 204 len: 0 microversion: 2.1 time: 0.143035 Aug 31 00:30:29.047602 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 605/1213] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:28 2022] DELETE /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:30:29.058175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:29.058880 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:29.065593 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:29.066172 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:29.066605 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:29.067298 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:29.067769 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:29.068192 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:29.202157 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:29.210132 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-24a4938c-242f-43ef-9a06-43f5a95a4091 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1576 microversion: 2.1 time: 0.156710 Aug 31 00:30:29.210727 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 609/1214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:29 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:30:30.231607 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:30.232313 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:30.238758 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:30.239244 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:30.239713 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:30.240400 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:30.240855 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:30.241282 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:30.382747 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:30.390534 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d0384800-6333-4f2e-9a5c-698ac884ea84 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1576 microversion: 2.1 time: 0.163177 Aug 31 00:30:30.391097 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 606/1215] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:30 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:31.416684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:31.417308 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:31.423764 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:31.424243 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:31.424725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:31.425375 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:31.425836 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:31.428026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:31.492454 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-4adc0878-66ad-4cf9-8fa9-b6ed24121d19 req-82e4a977-76d9-4a86-a7cb-7330e27c348d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0258002a-8a09-4ef0-94de-a15ac1ea23aa", "name": "network-vif-deleted", "tag": "8e99088b-8e89-4696-9dda-e1a593be3444"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:31.502829 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-4adc0878-66ad-4cf9-8fa9-b6ed24121d19 req-82e4a977-76d9-4a86-a7cb-7330e27c348d service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:31.502987 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:31.503446 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-4adc0878-66ad-4cf9-8fa9-b6ed24121d19 req-82e4a977-76d9-4a86-a7cb-7330e27c348d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:31.503953 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-4adc0878-66ad-4cf9-8fa9-b6ed24121d19 req-82e4a977-76d9-4a86-a7cb-7330e27c348d service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:31.511557 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-763519b1-11cf-4e64-a4fc-f1a550d82603 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 200 len: 1390 microversion: 2.1 time: 0.099040 Aug 31 00:30:31.512373 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 610/1216] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:31 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:31.515542 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-4adc0878-66ad-4cf9-8fa9-b6ed24121d19 req-82e4a977-76d9-4a86-a7cb-7330e27c348d service nova] Creating event network-vif-deleted:8e99088b-8e89-4696-9dda-e1a593be3444 for instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa on hv-cinder-85220 Aug 31 00:30:31.524510 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-4adc0878-66ad-4cf9-8fa9-b6ed24121d19 req-82e4a977-76d9-4a86-a7cb-7330e27c348d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035705 Aug 31 00:30:31.525289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 607/1217] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:32.540097 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:32.540695 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 0258002a-8a09-4ef0-94de-a15ac1ea23aa] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:32.547247 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:32.547737 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:32.548209 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:32.548936 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:32.549388 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:32.549810 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:32.563977 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] HTTP exception thrown: Instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa could not be found. Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Request method failure captured: Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa HTTP/1.1 Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqmZDWNgEzQZVG2e6-lzITfz_fDmkrocSPpoXIwlGL4FFXROum6O7eBrkYU6t7tTLuhLaLzLeUCcOxGSOa8e4tH5LBY97mfJ-R6VJeRsWakU6TtK-VhMPr0PtXX--zoAzpe1QGyiQSxqhR1GciQDgw1kelFNqHv7_VvuNb0TzKEKM2I Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:30:32.565616 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 5d8054341c0e46778e3b3db0b3dd1164 Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa could not be found. Aug 31 00:30:32.567903 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '0258002a-8a09-4ef0-94de-a15ac1ea23aa'} Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa could not be found. Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:32.569015 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa could not be found. Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa could not be found. Aug 31 00:30:32.570704 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:32.572314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Returning 404 to user: Instance 0258002a-8a09-4ef0-94de-a15ac1ea23aa could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:32.572314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-2323f8d1-d28c-4dd4-9ec3-04a06e91fe75 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa" status: 404 len: 111 microversion: 2.1 time: 0.031656 Aug 31 00:30:32.572314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 611/1218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:32 2022] GET /compute/v2.1/servers/0258002a-8a09-4ef0-94de-a15ac1ea23aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:35.604710 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:35.605287 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:35.606683 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [req-8e949580-75c4-4375-8940-4de3a4702498 req-17ea7e63-7a3c-414a-9230-9b268a832bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4", "tag": "8d1ea57b-30f1-4536-917c-3b6af1e48575"}]} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:35.612361 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:35.613392 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:35.613835 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:35.614553 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:35.615003 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:35.615421 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:35.618477 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8e949580-75c4-4375-8940-4de3a4702498 req-17ea7e63-7a3c-414a-9230-9b268a832bf8 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:35.618954 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8e949580-75c4-4375-8940-4de3a4702498 req-17ea7e63-7a3c-414a-9230-9b268a832bf8 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:35.619383 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [req-8e949580-75c4-4375-8940-4de3a4702498 req-17ea7e63-7a3c-414a-9230-9b268a832bf8 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:35.632782 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.compute.server_external_events [req-8e949580-75c4-4375-8940-4de3a4702498 req-17ea7e63-7a3c-414a-9230-9b268a832bf8 service nova] Creating event network-changed:8d1ea57b-30f1-4536-917c-3b6af1e48575 for instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 on hv-cinder-85220 Aug 31 00:30:35.638633 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [req-8e949580-75c4-4375-8940-4de3a4702498 req-17ea7e63-7a3c-414a-9230-9b268a832bf8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035278 Aug 31 00:30:35.639559 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 612/1219] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:30:35.641572 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:30:35.724256 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-4b8c7be0-417c-40a9-839f-8e3c7355374b tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 204 len: 0 microversion: 2.1 time: 0.123548 Aug 31 00:30:35.725140 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 608/1220] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:35 2022] DELETE /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:30:35.739489 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:35.740540 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:35.748723 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:35.750266 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:35.750721 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:35.751445 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:35.752084 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:35.752528 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:35.886517 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:35.894284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4efe8bfd-e198-4e36-a1ff-2792b92da213 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1577 microversion: 2.1 time: 0.162859 Aug 31 00:30:35.894858 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 613/1221] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:35 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:36.916175 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:36.916818 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:36.923239 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:36.923718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:36.924155 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:36.924839 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:36.925289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:36.925714 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:37.063264 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:37.071548 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-6220ddd2-7453-4496-a47e-de1a45ebb3ef tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1577 microversion: 2.1 time: 0.160038 Aug 31 00:30:37.072102 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 609/1222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:36 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:38.093141 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:38.093745 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:38.099874 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:38.100356 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:38.100798 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:38.101492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:38.101972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:38.102400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:38.178682 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8054341c0e46778e3b3db0b3dd1164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167da5798ea2451a9888a661b3c7f3e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:38.186722 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-ad63aa11-b402-4450-8565-254005bbf872 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 200 len: 1390 microversion: 2.1 time: 0.097545 Aug 31 00:30:38.187293 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 614/1223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:38 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:38.409002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-dd2a1b18-765d-4ac2-8097-f5325fd566d5 req-557373d3-65b1-4055-bd04-34d352d271ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4", "name": "network-vif-deleted", "tag": "8d1ea57b-30f1-4536-917c-3b6af1e48575"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:38.419919 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-dd2a1b18-765d-4ac2-8097-f5325fd566d5 req-557373d3-65b1-4055-bd04-34d352d271ec service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:38.420397 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-dd2a1b18-765d-4ac2-8097-f5325fd566d5 req-557373d3-65b1-4055-bd04-34d352d271ec service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:38.420830 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-dd2a1b18-765d-4ac2-8097-f5325fd566d5 req-557373d3-65b1-4055-bd04-34d352d271ec service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:38.432827 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-dd2a1b18-765d-4ac2-8097-f5325fd566d5 req-557373d3-65b1-4055-bd04-34d352d271ec service nova] Creating event network-vif-deleted:8d1ea57b-30f1-4536-917c-3b6af1e48575 for instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 on hv-cinder-85220 Aug 31 00:30:38.438199 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-dd2a1b18-765d-4ac2-8097-f5325fd566d5 req-557373d3-65b1-4055-bd04-34d352d271ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212412 Aug 31 00:30:38.439514 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 610/1224] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:39.114116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-21a0e32f-bbf5-46f6-92d5-cfbc4186e802 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:39.114631 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-21a0e32f-bbf5-46f6-92d5-cfbc4186e802 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:39.120822 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21a0e32f-bbf5-46f6-92d5-cfbc4186e802 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.121336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21a0e32f-bbf5-46f6-92d5-cfbc4186e802 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.121812 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21a0e32f-bbf5-46f6-92d5-cfbc4186e802 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.122494 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21a0e32f-bbf5-46f6-92d5-cfbc4186e802 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.122944 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21a0e32f-bbf5-46f6-92d5-cfbc4186e802 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.123363 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-21a0e32f-bbf5-46f6-92d5-cfbc4186e802 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.150370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-21a0e32f-bbf5-46f6-92d5-cfbc4186e802 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.148017 Aug 31 00:30:39.151404 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 615/1225] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:30:39 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/ips => generated 150 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:39.210404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:39.211101 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:39.217402 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.217915 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.218356 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.219046 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.219501 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.219926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.233550 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] HTTP exception thrown: Instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 could not be found. Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Request method failure captured: Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 HTTP/1.1 Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqmZDWNgEzQZVG2e6-lzITfz_fDmkrocSPpoXIwlGL4FFXROum6O7eBrkYU6t7tTLuhLaLzLeUCcOxGSOa8e4tH5LBY97mfJ-R6VJeRsWakU6TtK-VhMPr0PtXX--zoAzpe1QGyiQSxqhR1GciQDgw1kelFNqHv7_VvuNb0TzKEKM2I Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:30:39.235068 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 5d8054341c0e46778e3b3db0b3dd1164 Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 could not be found. Aug 31 00:30:39.236932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': 'bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4'} Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 could not be found. Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:39.238001 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 could not be found. Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 could not be found. Aug 31 00:30:39.239457 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.240880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Returning 404 to user: Instance bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:39.240880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-99552e8f-474b-4fb2-8dcf-384b14654e3d tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4" status: 404 len: 111 microversion: 2.1 time: 0.031806 Aug 31 00:30:39.240880 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 611/1226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:39 2022] GET /compute/v2.1/servers/bdd8b8fa-4ff6-4699-ba0f-e6d7fcaab0a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:39.690193 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:39.690687 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:39.697114 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.697590 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.698063 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.698748 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.699193 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.699613 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.713359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] HTTP exception thrown: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Request method failure captured: Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: DELETE /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b HTTP/1.1 Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqmZDWNgEzQZVG2e6-lzITfz_fDmkrocSPpoXIwlGL4FFXROum6O7eBrkYU6t7tTLuhLaLzLeUCcOxGSOa8e4tH5LBY97mfJ-R6VJeRsWakU6TtK-VhMPr0PtXX--zoAzpe1QGyiQSxqhR1GciQDgw1kelFNqHv7_VvuNb0TzKEKM2I Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:30:39.715018 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 5d8054341c0e46778e3b3db0b3dd1164 Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.716800 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '17d7ee56-2da9-457b-86e3-bc28a16e747b'} Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:39.717791 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.719516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.721176 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Returning 404 to user: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:39.721176 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-668dfb40-77fc-40dc-a613-156532718e21 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "DELETE /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 404 len: 111 microversion: 2.1 time: 0.030157 Aug 31 00:30:39.721176 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 616/1227] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:39 2022] DELETE /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:39.725294 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:39.725920 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] [instance: 17d7ee56-2da9-457b-86e3-bc28a16e747b] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:39.731798 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.732269 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.732699 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.733376 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:39.733817 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:39.734254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:39.747702 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] HTTP exception thrown: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Request method failure captured: Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b HTTP/1.1 Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqmZDWNgEzQZVG2e6-lzITfz_fDmkrocSPpoXIwlGL4FFXROum6O7eBrkYU6t7tTLuhLaLzLeUCcOxGSOa8e4tH5LBY97mfJ-R6VJeRsWakU6TtK-VhMPr0PtXX--zoAzpe1QGyiQSxqhR1GciQDgw1kelFNqHv7_VvuNb0TzKEKM2I Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:30:39.749177 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_167da5798ea2451a9888a661b3c7f3e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 167da5798ea2451a9888a661b3c7f3e6 Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-TestVolumeBootPattern-846706291 Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 5d8054341c0e46778e3b3db0b3dd1164 Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-TestVolumeBootPattern-846706291-project Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.751372 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '17d7ee56-2da9-457b-86e3-bc28a16e747b'} Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:39.752588 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. Aug 31 00:30:39.754434 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:39.756035 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Returning 404 to user: Instance 17d7ee56-2da9-457b-86e3-bc28a16e747b could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:39.756035 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-201bbf7b-5700-480f-8c99-f474a4494ca0 tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b" status: 404 len: 111 microversion: 2.1 time: 0.029561 Aug 31 00:30:39.757086 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 612/1228] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:39 2022] GET /compute/v2.1/servers/17d7ee56-2da9-457b-86e3-bc28a16e747b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:40.498728 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-38110cb4-44a3-45b2-a2ab-aed0bd49ce74 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43421229-5b05-46f9-9643-ad26729503c1"}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:40.501176 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-38110cb4-44a3-45b2-a2ab-aed0bd49ce74 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:40.508128 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38110cb4-44a3-45b2-a2ab-aed0bd49ce74 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:40.508603 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38110cb4-44a3-45b2-a2ab-aed0bd49ce74 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:40.509032 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38110cb4-44a3-45b2-a2ab-aed0bd49ce74 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:40.509716 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38110cb4-44a3-45b2-a2ab-aed0bd49ce74 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:40.510187 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38110cb4-44a3-45b2-a2ab-aed0bd49ce74 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:40.510606 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-38110cb4-44a3-45b2-a2ab-aed0bd49ce74 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:40.777359 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-38110cb4-44a3-45b2-a2ab-aed0bd49ce74 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "POST /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282366 Aug 31 00:30:40.777983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 617/1229] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 31 00:30:40 2022] POST /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:41.042390 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a17787da-478d-4cd3-9e02-90920224c6cb tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] Calling method '.version_select at 0x7fcd6bda4160>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:41.065076 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a17787da-478d-4cd3-9e02-90920224c6cb tempest-TestVolumeBootPattern-846706291 tempest-TestVolumeBootPattern-846706291-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-903737389" status: 202 len: 0 microversion: 2.1 time: 0.026423 Aug 31 00:30:41.070804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 613/1230] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 31 00:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-903737389 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:30:48.501400 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:48.502012 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:48.508631 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:48.509116 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:48.509547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:48.510279 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:48.510725 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:48.511153 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:48.605159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.objects.instance [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lazy-loading 'services' on Instance uuid c327dc31-7116-4b2e-8192-eccf9af816f3 {{(pid=132201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:30:48.680123 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-4bfee579-516d-42b0-8291-99de06a27c6c tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-volume_attachments/43421229-5b05-46f9-9643-ad26729503c1" status: 202 len: 0 microversion: 2.1 time: 0.183436 Aug 31 00:30:48.680983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 618/1231] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 31 00:30:48 2022] DELETE /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-volume_attachments/43421229-5b05-46f9-9643-ad26729503c1 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:30:48.690283 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-edd60ee8-27cc-4d6e-ad59-e68a518e0c7f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:48.692574 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-edd60ee8-27cc-4d6e-ad59-e68a518e0c7f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:48.700164 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-edd60ee8-27cc-4d6e-ad59-e68a518e0c7f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:48.700654 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-edd60ee8-27cc-4d6e-ad59-e68a518e0c7f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:48.701109 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-edd60ee8-27cc-4d6e-ad59-e68a518e0c7f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:48.701804 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-edd60ee8-27cc-4d6e-ad59-e68a518e0c7f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:48.702281 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-edd60ee8-27cc-4d6e-ad59-e68a518e0c7f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:48.702702 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-edd60ee8-27cc-4d6e-ad59-e68a518e0c7f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:48.732649 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-edd60ee8-27cc-4d6e-ad59-e68a518e0c7f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 Aug 31 00:30:48.733227 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 614/1232] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:30:48 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:49.745361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fc061fea-ea43-4da6-8c1a-233ae2043270 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:49.747735 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-fc061fea-ea43-4da6-8c1a-233ae2043270 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:49.755061 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fc061fea-ea43-4da6-8c1a-233ae2043270 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:49.755535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fc061fea-ea43-4da6-8c1a-233ae2043270 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:49.755972 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fc061fea-ea43-4da6-8c1a-233ae2043270 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:49.756659 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fc061fea-ea43-4da6-8c1a-233ae2043270 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:49.757151 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fc061fea-ea43-4da6-8c1a-233ae2043270 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:49.757570 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fc061fea-ea43-4da6-8c1a-233ae2043270 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:49.786434 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-fc061fea-ea43-4da6-8c1a-233ae2043270 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045358 Aug 31 00:30:49.786988 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 619/1233] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 31 00:30:49 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:30:49.846717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:49.847217 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:49.853735 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:49.854259 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:49.854698 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:49.855387 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:49.855847 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:49.856271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:49.883398 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Going to try to terminate instance {{(pid=132200) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:30:49.956784 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-01f86d87-f3f5-4c55-94fa-fcca941dafb6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 204 len: 0 microversion: 2.1 time: 0.113632 Aug 31 00:30:49.957370 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 615/1234] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:49 2022] DELETE /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:30:49.965491 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:49.966212 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:49.972162 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:49.972641 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:49.973075 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:49.973762 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:49.974239 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:49.974691 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:50.105379 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:50.113625 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-56a48fbf-fd54-4055-a314-157d58be6d23 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1682 microversion: 2.1 time: 0.151988 Aug 31 00:30:50.114214 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 620/1235] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:49 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:51.135704 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:51.136310 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:51.142370 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:51.142842 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:51.143267 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:51.144513 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:51.144955 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:51.145371 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:51.274312 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.policy [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132200) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:51.281979 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-15c418ff-f04a-43ea-8c6f-c5b3f2c3f353 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1682 microversion: 2.1 time: 0.150506 Aug 31 00:30:51.282535 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 616/1236] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:51 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:52.304426 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:52.305047 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:52.312092 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:52.312653 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:52.313159 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:52.313952 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:52.314492 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:52.315020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:52.405161 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.policy [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '988168279e8e495a985e209a35764f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f133f3096eb472d9a3c98ea9b81c1b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132201) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:30:52.413743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6384207a-a6c5-4612-9680-9f2582a47208 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 200 len: 1614 microversion: 2.1 time: 0.113167 Aug 31 00:30:52.414340 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 621/1237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:52 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 1614 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:30:52.593184 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [req-acbcfae3-c515-4df3-9813-e9a41213f2c2 req-c103c08f-c283-432b-b7a0-3182e97dd588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c327dc31-7116-4b2e-8192-eccf9af816f3", "name": "network-vif-deleted", "tag": "8c370e03-5387-4716-9387-3ac86e319959"}]} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:30:52.625374 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-acbcfae3-c515-4df3-9813-e9a41213f2c2 req-c103c08f-c283-432b-b7a0-3182e97dd588 service nova] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:52.625896 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-acbcfae3-c515-4df3-9813-e9a41213f2c2 req-c103c08f-c283-432b-b7a0-3182e97dd588 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:52.626331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [req-acbcfae3-c515-4df3-9813-e9a41213f2c2 req-c103c08f-c283-432b-b7a0-3182e97dd588 service nova] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:52.641439 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.compute.server_external_events [req-acbcfae3-c515-4df3-9813-e9a41213f2c2 req-c103c08f-c283-432b-b7a0-3182e97dd588 service nova] Creating event network-vif-deleted:8c370e03-5387-4716-9387-3ac86e319959 for instance c327dc31-7116-4b2e-8192-eccf9af816f3 on hv-cinder-85220 Aug 31 00:30:52.647352 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [req-acbcfae3-c515-4df3-9813-e9a41213f2c2 req-c103c08f-c283-432b-b7a0-3182e97dd588 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058764 Aug 31 00:30:52.647953 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 617/1238] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 31 00:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:30:53.434753 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:53.435361 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:53.441979 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:53.442454 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:53.443036 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:53.443727 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:53.444216 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:53.444632 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:53.458626 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 HTTP/1.1 Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:30:53.460267 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:53.462026 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': 'c327dc31-7116-4b2e-8192-eccf9af816f3'} Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:53.463294 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:53.464992 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:53.466624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:53.466624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-95bdac25-789c-4e86-b240-98bfa7e0ddcf tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 404 len: 111 microversion: 2.1 time: 0.030858 Aug 31 00:30:53.466624 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 622/1239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:53 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:53.472843 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7ed884c4-76e4-44c1-a195-e2fb2cde373e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '.version_select at 0x7fcd6bc43dc0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:53.493932 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7ed884c4-76e4-44c1-a195-e2fb2cde373e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807847025" status: 202 len: 0 microversion: 2.1 time: 0.025888 Aug 31 00:30:53.494533 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 618/1240] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 31 00:30:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807847025 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:30:55.249915 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:55.250411 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:55.257353 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:55.257897 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:55.258336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:55.259020 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:55.259469 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:55.259895 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:55.273188 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: DELETE /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 HTTP/1.1 Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:30:55.274746 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.276539 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': 'c327dc31-7116-4b2e-8192-eccf9af816f3'} Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:55.277545 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.279175 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.281062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:55.281062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-fd2d05af-eaec-4612-8ab0-63ea86b01477 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 404 len: 111 microversion: 2.1 time: 0.030086 Aug 31 00:30:55.281062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 623/1241] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:55 2022] DELETE /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:55.284959 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:55.285694 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: c327dc31-7116-4b2e-8192-eccf9af816f3] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:55.292695 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:55.293185 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:55.293622 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:55.294344 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:55.294795 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:55.295249 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:55.309012 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 HTTP/1.1 Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:30:55.310938 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.312759 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': 'c327dc31-7116-4b2e-8192-eccf9af816f3'} Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:55.313831 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. Aug 31 00:30:55.315475 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:55.317648 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance c327dc31-7116-4b2e-8192-eccf9af816f3 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:55.317648 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-87fe6087-ff5e-40e5-8df0-34be21cb4319 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3" status: 404 len: 111 microversion: 2.1 time: 0.032240 Aug 31 00:30:55.317648 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 619/1242] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:55 2022] GET /compute/v2.1/servers/c327dc31-7116-4b2e-8192-eccf9af816f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:56.451745 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:56.452236 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:56.459270 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.459753 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.460191 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.460877 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.461329 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.461758 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.475121 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: DELETE /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 HTTP/1.1 Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:30:56.476676 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.478516 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '1f6c5476-e889-42b0-a0e9-abd3044c4031'} Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:56.479371 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.480777 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.482215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:56.482215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-cda3e96b-d636-4426-b4ed-af27030d336f tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 404 len: 111 microversion: 2.1 time: 0.030154 Aug 31 00:30:56.482215 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 624/1243] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:56 2022] DELETE /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:56.486328 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:56.486942 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 1f6c5476-e889-42b0-a0e9-abd3044c4031] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:56.493331 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.493810 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.494279 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.494963 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.495413 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.495835 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.509316 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 HTTP/1.1 Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:30:56.510905 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.512718 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '1f6c5476-e889-42b0-a0e9-abd3044c4031'} Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:56.513728 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. Aug 31 00:30:56.515428 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.516860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance 1f6c5476-e889-42b0-a0e9-abd3044c4031 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:56.516860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f3806773-ca38-4a74-ab1a-024f94d020ad tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031" status: 404 len: 111 microversion: 2.1 time: 0.029714 Aug 31 00:30:56.516860 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 620/1244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:56 2022] GET /compute/v2.1/servers/1f6c5476-e889-42b0-a0e9-abd3044c4031 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:56.520612 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:56.521169 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:56.528246 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.528675 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.529114 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.529815 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.530305 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.530737 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.544953 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: DELETE /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f HTTP/1.1 Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:30:56.546535 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.548272 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': 'b297fa7f-eb55-4948-b66c-8f36ed32041f'} Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:56.549277 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.551336 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.552996 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:56.552996 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c7e34c42-d962-45a7-b6fd-a04389fdfac6 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 404 len: 111 microversion: 2.1 time: 0.031134 Aug 31 00:30:56.552996 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 625/1245] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:56 2022] DELETE /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:30:56.556289 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:56.556898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: b297fa7f-eb55-4948-b66c-8f36ed32041f] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:56.562926 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.563404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.563841 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.564526 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:56.564978 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:56.565404 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:56.579135 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f HTTP/1.1 Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:30:56.580624 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.582451 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': 'b297fa7f-eb55-4948-b66c-8f36ed32041f'} Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:56.583437 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. Aug 31 00:30:56.585052 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:56.586640 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance b297fa7f-eb55-4948-b66c-8f36ed32041f could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:56.586640 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-afc19e7a-068a-4356-8064-9fae9a27e020 tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f" status: 404 len: 111 microversion: 2.1 time: 0.029537 Aug 31 00:30:56.586640 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 621/1246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:56 2022] GET /compute/v2.1/servers/b297fa7f-eb55-4948-b66c-8f36ed32041f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:30:57.727968 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:57.728466 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.compute.api [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132201) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:57.734994 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:57.735501 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:57.735940 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:57.736637 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:57.737121 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:57.737547 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG oslo_concurrency.lockutils [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:57.751062 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: DELETE /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 HTTP/1.1 Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:30:57.752585 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: > Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.754385 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': '7bf2e097-da9b-4e83-a63c-bbd6fa880158'} Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:57.755392 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.757201 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.758908 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:57.758908 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-8953b490-ac82-46a5-a171-12bccce09f8a tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 404 len: 111 microversion: 2.1 time: 0.029812 Aug 31 00:30:57.758908 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 626/1247] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 31 00:30:57 2022] DELETE /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:57.762500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Calling method '>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:30:57.763137 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.compute.api [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] [instance: 7bf2e097-da9b-4e83-a63c-bbd6fa880158] Fetching instance by UUID {{(pid=132200) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:30:57.770019 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:57.770498 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:57.770925 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:57.771604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Acquiring lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:30:57.772051 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:30:57.772471 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG oslo_concurrency.lockutils [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Lock "65d8cb8b-7487-4666-acd5-7eed526c0edf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:30:57.786224 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] HTTP exception thrown: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Request method failure captured: Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 HTTP/1.1 Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqqCK9GsQEKneOpyEzcIz0qgNqHV86h4EZhZ4TMnBRHiqnRR5GFsXK9h35TqJv_VGEarVYFIJO4Jkrn9rtkTp9_6SL4BXLmNsaNpULEp_A39OpjuQqn2zA-2KKWo8aax-DFNQmUhOPkBImJyS_TR1NPCPg_Q21D93G4kblyMJ6EkkJQ Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:30:57.787749 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f133f3096eb472d9a3c98ea9b81c1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 8f133f3096eb472d9a3c98ea9b81c1b9 Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-952992719 Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 988168279e8e495a985e209a35764f2b Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-AttachVolumeNegativeTest-952992719-project Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: > Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.790028 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '7bf2e097-da9b-4e83-a63c-bbd6fa880158'} Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:30:57.791173 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. Aug 31 00:30:57.792895 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:30:57.794481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] Returning 404 to user: Instance 7bf2e097-da9b-4e83-a63c-bbd6fa880158 could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:30:57.794481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-f638ba4a-0f1a-4636-9f7d-c1736fc6c24e tempest-AttachVolumeNegativeTest-952992719 tempest-AttachVolumeNegativeTest-952992719-project] 10.222.0.49 "GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158" status: 404 len: 111 microversion: 2.1 time: 0.030757 Aug 31 00:30:57.794481 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 622/1248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 31 00:30:57 2022] GET /compute/v2.1/servers/7bf2e097-da9b-4e83-a63c-bbd6fa880158 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:31:03.479576 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-5f7b911d-7942-4050-a803-5793e130ca16 tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd6bd6fdc0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:03.530743 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5f7b911d-7942-4050-a803-5793e130ca16 tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/adb1969c-1575-47c1-a277-f59b450b55de" status: 200 len: 351 microversion: 2.1 time: 0.054870 Aug 31 00:31:03.531314 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 627/1249] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:31:03 2022] GET /compute/v2.1/os-volumes/adb1969c-1575-47c1-a277-f59b450b55de => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:31:04.857820 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-784d8a8d-a1c0-467e-985b-85e27a4dd9dd tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd6be9fdc0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:04.905064 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-784d8a8d-a1c0-467e-985b-85e27a4dd9dd tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/6758d843-0f9c-4582-9cc8-405d9c016cd0" status: 200 len: 351 microversion: 2.1 time: 0.050974 Aug 31 00:31:04.905621 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 623/1250] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:31:04 2022] GET /compute/v2.1/os-volumes/6758d843-0f9c-4582-9cc8-405d9c016cd0 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:31:06.233876 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-33a2c452-9034-495a-a985-a5e6c56a627b tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd735cd430>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:06.279471 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-33a2c452-9034-495a-a985-a5e6c56a627b tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/51ec880d-d3ac-4965-9e05-3ff5d3a0572c" status: 200 len: 351 microversion: 2.1 time: 0.049737 Aug 31 00:31:06.280028 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 628/1251] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:31:06 2022] GET /compute/v2.1/os-volumes/51ec880d-d3ac-4965-9e05-3ff5d3a0572c => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:31:06.292973 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-d8e7e234-1f3c-4a13-ba33-8ce34232e703 tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd6bc43af0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:06.374344 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-d8e7e234-1f3c-4a13-ba33-8ce34232e703 tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085727 Aug 31 00:31:06.374907 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 624/1252] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 31 00:31:06 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:06.388678 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-9de4237e-0dcc-435b-9a39-ec130e180957 tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd73630160>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:06.472275 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-9de4237e-0dcc-435b-9a39-ec130e180957 tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086728 Aug 31 00:31:06.472841 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 629/1253] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 31 00:31:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:31:06.485717 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-a7467855-32da-4bf8-bd31-6d6fe229aabf tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd6bc43430>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:06.568985 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-a7467855-32da-4bf8-bd31-6d6fe229aabf tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086902 Aug 31 00:31:06.569599 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 625/1254] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 31 00:31:06 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:06.582684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-27480a6f-b57b-445f-b525-1d721f80fa93 tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd6bd33dc0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:06.664534 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-27480a6f-b57b-445f-b525-1d721f80fa93 tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086098 Aug 31 00:31:06.665106 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 630/1255] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 31 00:31:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:31:06.678928 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5ccbefd8-f15a-423f-b0d6-53aece67280f tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd6bbd2af0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:06.765673 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5ccbefd8-f15a-423f-b0d6-53aece67280f tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090953 Aug 31 00:31:06.766279 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 626/1256] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 31 00:31:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:31:06.781861 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-16c89b06-11d7-46cc-8323-fc0e8863605c tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd735cd670>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:06.863957 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-16c89b06-11d7-46cc-8323-fc0e8863605c tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085863 Aug 31 00:31:06.864640 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 631/1257] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 31 00:31:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:31:06.877178 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-7a6c4b35-f059-4d21-9130-168bced6d7aa tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd6bcdf3a0>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:06.959247 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-7a6c4b35-f059-4d21-9130-168bced6d7aa tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085824 Aug 31 00:31:06.959861 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 627/1258] 10.222.0.49 () {58 vars in 1188 bytes} [Wed Aug 31 00:31:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:31:06.976871 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-3f4c64d1-6217-4d16-ba3a-92682bf8ab5c tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] Calling method '.version_select at 0x7fcd735ef0d0>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:07.068044 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-3f4c64d1-6217-4d16-ba3a-92682bf8ab5c tempest-VolumesTestJSON-1686500544 tempest-VolumesTestJSON-1686500544-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.099156 Aug 31 00:31:07.068622 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 632/1259] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 31 00:31:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:31:11.722117 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:11.722871 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG dbcounter [-] [132200] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:11.835261 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9d46dbbe-0b3d-4dd4-b0a3-6f4f1c7c6a08 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Action: 'create', calling method: .version_select at 0x7fcd6be9fb80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-593185569", "metadata": {"Type": "work"}}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9d46dbbe-0b3d-4dd4-b0a3-6f4f1c7c6a08 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Request method failure captured: Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 121 Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqvP7HbqSgAruTSJ8hk7sm_Lo4f_6ahpZoTdNyvP8ixLIwTk7JscnYVs_DLy-5LDWv1SYSp4SWg_vBLXghaTN70R6HlA6LhboWuaAE_wzlRBzI9yaHd3ucWM2FBad5FqySk6mstRzK-59kC9JLpCI6xEaSk01JOS5BnXNzZY-NZg3Fk Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:31:11.861254 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 5407f15ad3d247339b0e5eacb0feb994 Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-593185569", "metadata": {"Type": "work"}}} Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: Aug 31 00:31:11.863271 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-593185569', 'metadata': {'Type': 'work'}}}} Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:31:11.864384 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:31:11.867524 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:31:11.869286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:31:11.869286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.869286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-9d46dbbe-0b3d-4dd4-b0a3-6f4f1c7c6a08 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:31:11.869286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-9d46dbbe-0b3d-4dd4-b0a3-6f4f1c7c6a08 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141997 Aug 31 00:31:11.869286 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 628/1260] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 31 00:31:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:31:11.870321 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_api:SELECT=38 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:11.870682 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG dbcounter [-] [132201] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:11.874674 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6bf3ec8e-c582-47a7-ad85-bb30a68d79f6 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Action: 'create', calling method: .version_select at 0x7fcd735ef4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-867972164", "metadata": {"Type": "work"}}} {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6bf3ec8e-c582-47a7-ad85-bb30a68d79f6 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Request method failure captured: Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 119 Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqvP7HbqSgAruTSJ8hk7sm_Lo4f_6ahpZoTdNyvP8ixLIwTk7JscnYVs_DLy-5LDWv1SYSp4SWg_vBLXghaTN70R6HlA6LhboWuaAE_wzlRBzI9yaHd3ucWM2FBad5FqySk6mstRzK-59kC9JLpCI6xEaSk01JOS5BnXNzZY-NZg3Fk Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:31:11.879684 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 5407f15ad3d247339b0e5eacb0feb994 Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-867972164", "metadata": {"Type": "work"}}} Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: Aug 31 00:31:11.881487 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-867972164', 'metadata': {'Type': 'work'}}}} Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi '0' Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:31:11.882707 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:31:11.884438 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:31:11.886009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:31:11.886009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.886009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-6bf3ec8e-c582-47a7-ad85-bb30a68d79f6 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:31:11.886009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-6bf3ec8e-c582-47a7-ad85-bb30a68d79f6 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012487 Aug 31 00:31:11.886009 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 633/1261] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 31 00:31:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:31:11.890548 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0497d568-eaa7-4ecf-b710-868ddc0dc9e1 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Action: 'create', calling method: .version_select at 0x7fcd6bc608b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1805066876", "metadata": {"Type": "work"}}} {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0497d568-eaa7-4ecf-b710-868ddc0dc9e1 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Request method failure captured: Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 119 Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqvP7HbqSgAruTSJ8hk7sm_Lo4f_6ahpZoTdNyvP8ixLIwTk7JscnYVs_DLy-5LDWv1SYSp4SWg_vBLXghaTN70R6HlA6LhboWuaAE_wzlRBzI9yaHd3ucWM2FBad5FqySk6mstRzK-59kC9JLpCI6xEaSk01JOS5BnXNzZY-NZg3Fk Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:31:11.897002 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 5407f15ad3d247339b0e5eacb0feb994 Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1805066876", "metadata": {"Type": "work"}}} Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: Aug 31 00:31:11.898898 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1805066876', 'metadata': {'Type': 'work'}}}} Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi '' Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:31:11.900121 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:31:11.902112 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:31:11.903604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:31:11.903604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.903604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-0497d568-eaa7-4ecf-b710-868ddc0dc9e1 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:31:11.903604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-0497d568-eaa7-4ecf-b710-868ddc0dc9e1 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011642 Aug 31 00:31:11.903604 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 629/1262] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 31 00:31:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:31:11.907763 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-28d82420-0c10-44cf-98d3-7e25071d102f tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Calling method '.version_select at 0x7fcd735cd430>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:11.938364 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-28d82420-0c10-44cf-98d3-7e25071d102f tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] HTTP exception thrown: Volume tempest-invalid-1864209656 could not be found. Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-28d82420-0c10-44cf-98d3-7e25071d102f tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Request method failure captured: Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1864209656 HTTP/1.1 Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqvP7HbqSgAruTSJ8hk7sm_Lo4f_6ahpZoTdNyvP8ixLIwTk7JscnYVs_DLy-5LDWv1SYSp4SWg_vBLXghaTN70R6HlA6LhboWuaAE_wzlRBzI9yaHd3ucWM2FBad5FqySk6mstRzK-59kC9JLpCI6xEaSk01JOS5BnXNzZY-NZg3Fk Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:31:11.940778 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 5407f15ad3d247339b0e5eacb0feb994 Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Volume tempest-invalid-1864209656 could not be found. Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': 'tempest-invalid-1864209656'} Aug 31 00:31:11.942580 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1864209656 could not be found. (HTTP 404) (Request-ID: req-18a2505c-f4ee-4f35-a330-e7e19895f87c) Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:11.943686 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:31:11.945284 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1864209656 could not be found. Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:31:11.947166 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1864209656 could not be found. Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1864209656 could not be found. Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-28d82420-0c10-44cf-98d3-7e25071d102f tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Returning 404 to user: Volume tempest-invalid-1864209656 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-28d82420-0c10-44cf-98d3-7e25071d102f tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1864209656" status: 404 len: 99 microversion: 2.1 time: 0.038630 Aug 31 00:31:11.949011 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 634/1263] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 31 00:31:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1864209656 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 00:31:11.952156 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-460b6bc6-214e-4f5d-94ca-670d3160b58a tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003933 Aug 31 00:31:11.952645 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 630/1264] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 31 00:31:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 00:31:11.961285 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-5500b99e-fe29-413d-b6a2-ae8718b2c794 tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003639 Aug 31 00:31:11.961759 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 635/1265] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 31 00:31:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 00:31:11.969676 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5d48dee8-72c7-4c7e-a344-4e844466071d tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Calling method '.version_select at 0x7fcd6bc60a60>' {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:11.996637 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.wsgi [None req-5d48dee8-72c7-4c7e-a344-4e844466071d tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] HTTP exception thrown: Volume 67aa0b9e-16fa-4d12-a500-124690e51d2d could not be found. Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5d48dee8-72c7-4c7e-a344-4e844466071d tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Request method failure captured: Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: request: DELETE /compute/v2.1/os-volumes/67aa0b9e-16fa-4d12-a500-124690e51d2d HTTP/1.1 Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept: application/json Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Accept-Encoding: identity Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Connection: close Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Length: 0 Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Content-Type: application/json Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Host: 10.222.0.49 Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: Openstack-System-Scope: None Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: User-Agent: python-urllib3/1.26.12 Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Auth-Token: gAAAAABjDqvP7HbqSgAruTSJ8hk7sm_Lo4f_6ahpZoTdNyvP8ixLIwTk7JscnYVs_DLy-5LDWv1SYSp4SWg_vBLXghaTN70R6HlA6LhboWuaAE_wzlRBzI9yaHd3ucWM2FBad5FqySk6mstRzK-59kC9JLpCI6xEaSk01JOS5BnXNzZY-NZg3Fk Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Id: None Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Domain-Name: None Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Identity-Status: Confirmed Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Is-Admin-Project: True Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Id: default Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Domain-Name: Default Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Project-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Role: member,reader Aug 31 00:31:11.998634 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Roles: member,reader Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-Tenant-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Id: default Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Domain-Name: Default Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Id: 5407f15ad3d247339b0e5eacb0feb994 Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: X-User-Name: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: method: Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: exception: Volume 67aa0b9e-16fa-4d12-a500-124690e51d2d could not be found. Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: action_args: {'id': '67aa0b9e-16fa-4d12-a500-124690e51d2d'} Aug 31 00:31:12.000433 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: {{(pid=132200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67aa0b9e-16fa-4d12-a500-124690e51d2d could not be found. (HTTP 404) (Request-ID: req-8c247a9f-7b5c-429e-ba29-7d2b7341c3ce) Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:12.001529 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:31:12.004211 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67aa0b9e-16fa-4d12-a500-124690e51d2d could not be found. Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:31:12.005890 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67aa0b9e-16fa-4d12-a500-124690e51d2d could not be found. Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67aa0b9e-16fa-4d12-a500-124690e51d2d could not be found. Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: DEBUG nova.api.openstack.wsgi [None req-5d48dee8-72c7-4c7e-a344-4e844466071d tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Returning 404 to user: Volume 67aa0b9e-16fa-4d12-a500-124690e51d2d could not be found. {{(pid=132200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: INFO nova.api.openstack.requestlog [None req-5d48dee8-72c7-4c7e-a344-4e844466071d tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/67aa0b9e-16fa-4d12-a500-124690e51d2d" status: 404 len: 109 microversion: 2.1 time: 0.033857 Aug 31 00:31:12.007500 dv-cinder-852209-8-iscsi devstack@n-api.service[132200]: [pid: 132200|app: 0|req: 631/1266] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 31 00:31:11 2022] DELETE /compute/v2.1/os-volumes/67aa0b9e-16fa-4d12-a500-124690e51d2d => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:31:12.010171 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c52dcf36-cb6d-48b4-9f02-76587e19988a tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Calling method '.version_select at 0x7fcd735e9700>' {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:31:12.037203 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.wsgi [None req-c52dcf36-cb6d-48b4-9f02-76587e19988a tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] HTTP exception thrown: Volume ecd325b3-0856-4a5d-8968-c9ed6a7917c2 could not be found. Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c52dcf36-cb6d-48b4-9f02-76587e19988a tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Request method failure captured: Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: request: GET /compute/v2.1/os-volumes/ecd325b3-0856-4a5d-8968-c9ed6a7917c2 HTTP/1.1 Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept: application/json Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Accept-Encoding: identity Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Connection: close Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Length: 0 Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Content-Type: application/json Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Host: 10.222.0.49 Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: Openstack-System-Scope: None Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: User-Agent: python-urllib3/1.26.12 Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Auth-Token: gAAAAABjDqvP7HbqSgAruTSJ8hk7sm_Lo4f_6ahpZoTdNyvP8ixLIwTk7JscnYVs_DLy-5LDWv1SYSp4SWg_vBLXghaTN70R6HlA6LhboWuaAE_wzlRBzI9yaHd3ucWM2FBad5FqySk6mstRzK-59kC9JLpCI6xEaSk01JOS5BnXNzZY-NZg3Fk Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Id: None Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Domain-Name: None Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Identity-Status: Confirmed Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Is-Admin-Project: True Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Id: default Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Domain-Name: Default Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Project-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Role: member,reader Aug 31 00:31:12.039402 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Roles: member,reader Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_86d3bb0eb86e4d4d969a7d6fba2efbc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Id: 86d3bb0eb86e4d4d969a7d6fba2efbc2 Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-Tenant-Name: tempest-VolumesNegativeTest-1462573282 Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Id: default Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Domain-Name: Default Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Id: 5407f15ad3d247339b0e5eacb0feb994 Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: X-User-Name: tempest-VolumesNegativeTest-1462573282-project Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: method: Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: exception: Volume ecd325b3-0856-4a5d-8968-c9ed6a7917c2 could not be found. Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: action_args: {'id': 'ecd325b3-0856-4a5d-8968-c9ed6a7917c2'} Aug 31 00:31:12.041059 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: {{(pid=132201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ecd325b3-0856-4a5d-8968-c9ed6a7917c2 could not be found. (HTTP 404) (Request-ID: req-3a577f38-8976-4853-8db1-0fa0fca3acb1) Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:12.042111 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:31:12.043717 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ecd325b3-0856-4a5d-8968-c9ed6a7917c2 could not be found. Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:31:12.045370 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ecd325b3-0856-4a5d-8968-c9ed6a7917c2 could not be found. Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ecd325b3-0856-4a5d-8968-c9ed6a7917c2 could not be found. Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: ERROR nova.api.openstack.wsgi Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: DEBUG nova.api.openstack.wsgi [None req-c52dcf36-cb6d-48b4-9f02-76587e19988a tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] Returning 404 to user: Volume ecd325b3-0856-4a5d-8968-c9ed6a7917c2 could not be found. {{(pid=132201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: INFO nova.api.openstack.requestlog [None req-c52dcf36-cb6d-48b4-9f02-76587e19988a tempest-VolumesNegativeTest-1462573282 tempest-VolumesNegativeTest-1462573282-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ecd325b3-0856-4a5d-8968-c9ed6a7917c2" status: 404 len: 109 microversion: 2.1 time: 0.034400 Aug 31 00:31:12.046983 dv-cinder-852209-8-iscsi devstack@n-api.service[132201]: [pid: 132201|app: 0|req: 636/1267] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 31 00:31:12 2022] GET /compute/v2.1/os-volumes/ecd325b3-0856-4a5d-8968-c9ed6a7917c2 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)